Whisk together the milk, cream, eggs, and nutmeg until smooth. Sprinkle with salt and pepper to taste, and whisk to incorporate. Gently pour the egg mixture over the broccoli. Bake for 35-40 minutes, until the center has set. It's fine if it's still a bit wobbly, as it will continue to cook when you remove it from the oven. Set aside to cool for 10 minutes before serving.