I think you've got to ask what role the mech is expected to play. Very generally, heavy mechs were meant to be the main force that engaged the enemy. Assault mechs were specialists for when you needed maximum power, but were too expensive and slow to make up the majority of your army. Medium mechs were jacks of all trades, not as good as a heavy at pure combat, but faster and cheaper. Light mechs were scouts and harassers, dirt cheap by mech standards but falling way short in raw combat power.
With ballooning military budgets and much higher mech costs, the savings you get from using a light mech have started to shrink. When you're using an XXXXL Engine, Blue Shield System, stealth armor, ECM, targeting computer, and Clan heavy lasers on your 25 ton mech... wouldn't you be better served by buying an old tech Atlas?
I think late generation light mechs need to have a role or two, and specialize into that. The Dart 3S is a good example. 25 tons, 9/14 movement, 3 small pulse lasers. It's an awesome infantry platoon killer, and it's extremely cheap. The only new tech on it would be the pulse lasers. Now you don't want an enemy mech within 5 miles of your Dart, but it's a high speed pain in the ass for your opponent. If you've got an extra Leopard dropship you can bring along, then a lance of Darts can cause all sorts of problems that your enemy can't ignore.
In larger battles, light mechs should probably provide some kind of benefit to the unit as a whole (ECM, Beagle, C3, Narc, Tag, etc) in a relatively inexpensive package, but survive by being a low enough priority target that it's not worth shooting at them. Are you gonna shoot that guy who jumped 10 into heavy woods with an ECM suite, who is shooting an inferno SRM-6 and a medium laser? Or are you gonna shoot that heavy mech who got a +2 and is blasting away with 2 PPCs and a Gauss Rifle? Light mechs can survive a long time by never being the most important target.
I think it's a mistake to layer on the most expensive technologies possible, when much of the appeal of the light mech is its cost. Remember that as advanced tech becomes more common, that also means that dropships and jumpships become more common as well. Each individual mech bay is less important.