One thing you will find that everything works in threes or fours when it comes to

combat units, sometimes five. These designs are called triangular, square, or
pentagonal respectively. So for example an infantry battalion might have three
companies of riflemen. These are called combat units or combat arms.

Then it needs more than that! The company also has a headquarters unit. All
units have a headquarters subunit, which is usually the same level, or one level
down from the standard combat arm. So a battalion of 3 companies has a
headquarters company or platoon. An infantry brigade has a headquarters
battalion or company. etc. On top of that there are, as you identified, specialist
units - weapons companies, support companies, engineer companies etc. These
are combat support units in that they provide direct support to the main unit.

There are also combat service support: logistics, military police, signals, met
units, etc, these add 'services' to the main unit.

So what you see in any organisation is usually three-five main subunits at one
level below the formation. Eg a division has 3-5 brigades. Brigade has 3-5
battalions. Battalion has 3-5 companies. Company has 3-5 platoons. Additionally
these units have combat support and combat service support at two or three
levels down. So a Brigade has 3-5 rifle battalions, engineer companies, signals
companies, supply companies - and it has transport platoon, MP platoons, NBC
platoon, road traffic platoons, service platoons etc. Artillery is exception. All units
usually have 1 subunit of artillery at combat lvl. So our Brigade now includes 1
battalion of artillery. It looks like this.

BRIGADE
- Brigade HQ (Company)
- Rifle Battalion
- Rifle Battalion
- Rifle Battalion
- Artillery Battalion
- Engineer Company
- Signals Company
- Supply Company
- Transport Company
- MP Platoon
- NBC Platoon
- Services Platoon

See that as the demand for the skills provided by the subunit decrease, so does
size of subunit. So Brigade would never have NBC battalion. It might have NBC
company in certain circumstances (high chance of nbc battlefield). Battalion
would never have MP company (unless it was MP battalion) but may have MP
platoon, depending on certain circumstances (penal unit, conscripts w/ low
morale, etc.) I would consider tehse units as "a platoons worth" of what they are.
So for example, do 4000 men need a platoon's worth of military policemen? Up
to you. Like I said, context. Do they need a platoon's worth of K9 units? If
involved in COIN work, maybe they do. If they're a mechanised infantry brigade
designed to storm the fulda gap, it's a waste.

Here is trick with military formation design: waste nothing. Exaggerate nothing.
Strip down to only what you need and never try to be quirky by throwing in loads
of things that you do not need. It weighs your unit down substantially and
provides diminishing returns. You could have 5,000 military policemen in a
division, but the returns you would get on unit discipline don't match feeding and
watering all of them in the field. Similarly you could have 5,000 trucks in a
division, but division needs only 1,200 (for eg.) trucks, why add more?

(The irony is delicious coming from guy with 24.5k man division, I am sure.)