Whisk the dry ingredients: in a medium bowl, whisk together the flour, cocoa powder, hot cocoa mix, baking soda, and salt until no lumps remain. Set aside.
Cream the butter and sugars: in a large bowl, beat the softened butter with the granulated sugar and brown sugar on medium speed until pale and fluffy, about 2 to 3 minutes. Scrape down the sides of the bowl.
Add the eggs and vanilla: beat in the eggs one at a time, then the vanilla extract, mixing just until combined. The batter should look smooth and glossy.
Mix in the dry ingredients: add the flour mixture in two additions, mixing on low speed just until the last streaks of flour disappear. Do not overmix, or the cookies turn tough.
Fold in the chocolate chips: stir in the semisweet chocolate chips with a spatula until evenly distributed through the dough.
Chill the dough: cover the bowl and refrigerate for 30 minutes. Chilled dough holds its shape and bakes thick instead of spreading flat.
Scoop and bake: preheat the oven to 350°F (175°C) and line two baking sheets with parchment paper. Scoop rounded tablespoons of dough (about 2 tablespoons each) and place them 2 inches apart on the sheets. Bake for 9 minutes, until the edges are set and the centers still look slightly soft.
Add the marshmallows and chocolate: pull the pan from the oven and immediately press 3 mini marshmallows (or one marshmallow half, cut-side down) and one square of milk chocolate into the center of each cookie. Return to the oven for 2 to 3 minutes more, just until the marshmallows puff and soften.
Cool and finish: let the cookies rest on the pan for 5 minutes, then sprinkle with crushed candy cane if you like. Move to a wire rack to cool completely — the chocolate squares will set as they cool.