Line a plate with a few layers of paper towels. In a large, well-seasoned wok or cast iron skillet, heat the oil over medium-high heat. Fry the tofu in oil until golden brown all over, about 3 minutes on each side. (Do this in batches to avoid crowding the pan if needed.) Drain the tofu on the paper towel-lined plate, and set aside. Discard all but 1 tablespoon of oil from the skillet. Return pan to medium heat, and add the butter. When melted, stir in the ginger, chiles, green garlic, shallots and a pinch of salt. Cook, stirring, until tender, about 10 minutes. Stir in the soy sauce, brown rice vinegar, sugar and black pepper. Return the tofu to the pan. Cook, stirring, until heated through, 2-4 minutes. Toss to coat in the sauce.