Whew! Your story sounds similar to mine. My youngest is also an "emotional" person and the school experience seemed to be wringing the passions of learning out of him and was affecting his sense of self. Sometimes the teachers were the bullies. After trying to work with the school we realized that we were able to do so much better are on our own. Once the decision was made and acted on, our mornings turned into peaceful times rather than stressful ones. I found it took each of my kids about 6 months to find their balance again, and to get passed the idea of someone telling one how to organize one's day and how to learn. It also took sometime for me to let go completely of my fears and trust the situation.
Also, fortunately for me I live in a community where "weird" people are pretty much the norm. A lot of the things that you enjoy as well..yoga, animals, the outdoors. Sometimes it feels like we live in a sauna:) I feel very fortunate to be here, though it is certainly not for everyone.
Have you found other unschoolers in your area? If you ever have a chance to travel, I would recommend visiting here in Monteverde, Costa Rica, or other parts of Costa Rica as well. Children are held in very high esteem here.
Good luck, and keep posting. I would love to hear about what is happening, changes, new discoveries, adventures that you and your family are going through as you start this new way of life together.