If you used Mesh Combine, the two meshes don't actually merge together and will keep their own edges. So when you go to bevel the entire combined object, all the edges are beveled and it would look similar to your screenshot.
You could instead select the specific edges you wish to bevel rather than beveling the entire object.
You could also use a different technique to combine such as a Boolean Union or many others such as manually merging components.
