I'd say this could only really work for casual. Having no sleeves is a major no-no in lolita, that's why most girls wear sleeved blouses under jumperskirts unless the weather is too hot. No matter which style, it's important to have your shoulders covered.
On a side note, if you wanted to layer a cardigan over it for an outfit with a skirt that could work. It could be a good base blouse to put the cardigan over.