Files
firestorm/MW4COMPARE/reports/missions-decoded-diff.txt
T
83478b7666 Add MW4COMPARE: .mw4 decompiler toolchain and V4H comparison harness
Tooling built to recover editable source for six 'Mech chassis that exist
in the parallel FS_Build_V4H build but not in this repo. Reverse-engineers
every compiled record type in the .mw4 package format back to the .data /
.instance / .subsystems / .damage / .contents / .torso / .engine /
.armature sources the content pipeline consumes.

Nothing here is wired into the game build. It is a standalone analysis
harness run from Linux.

Package format
--------------
"#VBD" container. Directory records are [len][name][FILETIME][origSize]
[storedSize][offset], payload base at dword 0x0C. A record is stored raw
when storedSize == origSize, otherwise LZW (9->12-bit LSB-first codes,
256=clear, 257=EOF, dict from 258), per Database.cpp:451.

GameModel records are flat /Zp4 structs following the C++ inheritance
chain Entity(0) -> Mover(28) -> MWObject(80) -> Vehicle(664) -> Mech(756),
1636 bytes total. CreateMessage records follow Replicator -> Entity ->
Mover -> MWMover -> MWObject -> Vehicle -> Mech from start=16 (the
undeclared Connection__Message header), ending at 341 and padded to 344.

tools/decompile/
----------------
  datamap.py        header-driven layout engine; CHAIN + ANCHORS
                    {Vehicle:664, Mech:756} assert the struct offsets
  mw4msg.py         CreateMessage reader/walker
  data.py           .data      constants.py  define/table symbol resolution
  damage.py         .damage    contents.py   .contents
  smallmodel.py     .torso + .engine         instance.py  .instance
  armature.py / armature_parts.py  .armature + armaturedata/armaturevideo
  assembly.py       joint hierarchy renderer
  make_generic_doll.py  builds generic MFD/Radar damage dolls
  verify_*.py       per-type round-trip verifiers

Verified round-trip across all 64 shared chassis:
  .armature      2938/2976 pages     .subsystems  7579/7585 keys
  .data map      6071/6071 values    .data trip   8291/8306 keys
  .damage        6605/6605 keys      .contents    7480/7480 keys
  .torso+.engine 1280/1280 keys      .instance     896/896 keys, 64/64 pages
  armature_parts 1202/1202 .data, 1149/1202 .video

Layout-discovery lessons (documented in DECOMPILING.md)
-------------------------------------------------------
- Never let a field map be discovered by the values that verify it. A
  value-matching pass reported 4288/4288 while mis-assigning 34 keys. The
  map was rebuilt from header declaration order, anchored on uniquely
  resolved fields.
- Read the factory, not the data. 12 .data fields and 5 Torso fields are
  declared plain Stuff::Scalar but multiplied by Radians_Per_Degree in
  Mech_Tool.cpp:889 / Torso_Tool.cpp.
- Strip typedefs before walking a header. A stray `typedef int AttributeID;`
  masked a missing ClassID - two 4-byte errors cancelling out, caught only
  by the ANCHORS assertion.
- A verifier that silently narrows its own input reports success. Braced
  blocks must be hidden before splitting pages, replacing both CR and LF,
  because a `Shadow={...}` block contains a line reading `[shadow]` and
  splitlines() also splits on bare CR.
- NSWIZZLE is undefined, so the #else branch is live and orders members
  differently. bool is 1 byte; char x[MaxStringLength] is 256.
- V4H carries stale Mech IDs (their Atlas is 5, ours 6), so 64 of 65 shared
  chassis are off by one; --retarget-ids emits $(M_<Chassis>)/$(IDS_<Chassis>).

reports/ holds generated diffs. The two ~5 MB manifest-*.tsv intermediates
are gitignored; regenerate everything with run-comparison.sh.

Co-authored-by: Claude Opus 5 (Anthropic) <noreply@anthropic.com>
Co-authored-by: GitHub Copilot <copilot@github.com>
2026-08-08 16:47:57 -05:00

174 lines
8.4 KiB
Plaintext

### bigcity.mw4
# entries: A=80 B=80 A_only=0 B_only=0 decoded-differ=3
~ missions/bigcity/bigcity.contents A=585438B B=585438B
~ missions/bigcity/bigcity.lights A=131340B B=131340B
~ missions/bigcity/bigcitynight.lights A=131340B B=131340B
### cantina.mw4
# entries: A=31 B=31 A_only=0 B_only=0 decoded-differ=3
~ missions/cantina/cantina.contents A=80886B B=80886B
~ missions/cantina/cantina.lights A=131347B B=131347B
~ missions/cantina/cantinanight.lights A=131347B B=131347B
### cantinasiege.mw4
# entries: A=50 B=50 A_only=0 B_only=0 decoded-differ=3
~ missions/cantinasiege/cantinasiege.contents A=91546B B=91546B
~ missions/cantinasiege/cantinasiege.lights A=131352B B=131352B
~ missions/cantinasiege/cantinasiegenight.lights A=131352B B=131352B
### coliseum.mw4
# entries: A=47 B=47 A_only=0 B_only=0 decoded-differ=3
~ missions/coliseum/coliseum.contents A=52954B B=52954B
~ missions/coliseum/coliseum.lights A=33033B B=33033B
~ missions/coliseum/coliseumnight.lights A=33033B B=33033B
### cpark.mw4
# entries: A=31 B=31 A_only=0 B_only=0 decoded-differ=3
~ missions/centralpark/centralpark.contents A=321566B B=321566B
~ missions/centralpark/centralpark.lights A=131355B B=131355B
~ missions/centralpark/centralparknight.lights A=131355B B=131355B
### dustbowl.mw4
# entries: A=28 B=28 A_only=0 B_only=0 decoded-differ=3
~ missions/dustbowl/dustbowl.contents A=10794B B=10794B
~ missions/dustbowl/dustbowl.lights A=131433B B=131433B
~ missions/dustbowl/dustbowlnight.lights A=131433B B=131433B
### factory.mw4
# entries: A=25 B=25 A_only=0 B_only=0 decoded-differ=2
~ missions/factory/factory.contents A=136990B B=136990B
~ missions/factory/factory.lights A=33042B B=33042B
### fbite.mw4
# entries: A=32 B=32 A_only=0 B_only=0 decoded-differ=3
~ missions/frostbite/frostbite.contents A=91850B B=91850B
~ missions/frostbite/frostbite.lights A=131351B B=131351B
~ missions/frostbite/frostbitenight.lights A=131351B B=131351B
### freezer.mw4
# entries: A=165 B=135 A_only=30 B_only=0 decoded-differ=4
+A audio/vo/generic/mp/ahh.wav 54966B
+A audio/vo/generic/mp/ahh.wav{handle} 10B
+A audio/vo/generic/mp/aww.wav 11958B
+A audio/vo/generic/mp/aww.wav{handle} 10B
+A audio/vo/generic/mp/boo1.wav 97718B
+A audio/vo/generic/mp/boo1.wav{handle} 10B
+A audio/vo/generic/mp/boo2.wav 131510B
+A audio/vo/generic/mp/boo2.wav{handle} 10B
+A audio/vo/generic/mp/boo3.wav 138166B
+A audio/vo/generic/mp/boo3.wav{handle} 10B
+A audio/vo/generic/mp/cheer1.wav 200118B
+A audio/vo/generic/mp/cheer1.wav{handle} 10B
+A audio/vo/generic/mp/cheer2.wav 102838B
+A audio/vo/generic/mp/cheer2.wav{handle} 10B
+A audio/vo/generic/mp/cheer3.wav 95670B
+A audio/vo/generic/mp/cheer3.wav{handle} 10B
+A audio/vo/generic/mp/cheer4.wav 152246B
+A audio/vo/generic/mp/cheer4.wav{handle} 10B
+A audio/vo/generic/mp/cheer5.wav 92086B
+A audio/vo/generic/mp/cheer5.wav{handle} 10B
+A audio/vo/generic/mp/cheer8.wav 14076B
+A audio/vo/generic/mp/cheer8.wav{handle} 10B
+A audio/vo/generic/mp/cheer9.wav 63670B
+A audio/vo/generic/mp/cheer9.wav{handle} 10B
+A audio/vo/generic/mp/jeers.wav 127414B
+A audio/vo/generic/mp/jeers.wav{handle} 10B
+A audio/vo/generic/mp/roar.wav 9654B
+A audio/vo/generic/mp/roar.wav{handle} 10B
+A audio/vo/generic/mp/stadamb.wav 23478B
+A audio/vo/generic/mp/stdamb.wav{handle} 10B
~ missions/freezer/freezer.contents A=16338B B=16338B
~ missions/freezer/freezer.lights A=189B B=189B
~ missions/freezer/freezernight.lights A=189B B=189B
~ missions/freezer/scripts/freezer_teamattrition.abl A=10710B B=832B
### gbait.mw4
# entries: A=32 B=32 A_only=0 B_only=0 decoded-differ=3
~ missions/gatorbait/gatorbait.contents A=131102B B=131102B
~ missions/gatorbait/gatorbait.lights A=131344B B=131344B
~ missions/gatorbait/gatorbaitnight.lights A=131344B B=131344B
### ghosthighway.mw4
# entries: A=30 B=30 A_only=0 B_only=0 decoded-differ=3
~ missions/ghosthighway/ghosthighway.contents A=46262B B=46262B
~ missions/ghosthighway/ghosthighway.lights A=131356B B=131356B
~ missions/ghosthighway/ghosthighwaynight.lights A=131356B B=131356B
### grassland.mw4
# entries: A=133 B=133 A_only=0 B_only=0 decoded-differ=3
~ missions/grassland/grassland.contents A=191662B B=191662B
~ missions/grassland/grassland.lights A=189B B=189B
~ missions/grassland/grasslandnight.lights A=189B B=189B
### hideaway.mw4
# entries: A=131 B=131 A_only=0 B_only=0 decoded-differ=3
~ missions/hideaway/hideaway.contents A=26798B B=26798B
~ missions/hideaway/hideaway.lights A=33136B B=33136B
~ missions/hideaway/hideawaynight.lights A=33136B B=33136B
### hotplate.mw4
# entries: A=129 B=129 A_only=0 B_only=0 decoded-differ=3
~ missions/hotplate/hotplate.contents A=134446B B=134446B
~ missions/hotplate/hotplate.lights A=189B B=189B
~ missions/hotplate/hotplatenight.lights A=189B B=189B
### icity.mw4
# entries: A=26 B=26 A_only=0 B_only=0 decoded-differ=3
~ missions/innercity/innercity.contents A=228938B B=228938B
~ missions/innercity/innercity.lights A=131351B B=131351B
~ missions/innercity/innercitynight.lights A=131351B B=131351B
### jungle.mw4
# entries: A=36 B=36 A_only=0 B_only=0 decoded-differ=3
~ missions/jungle/jungle.contents A=109430B B=109430B
~ missions/jungle/jungle.lights A=33121B B=33121B
~ missions/jungle/junglenight.lights A=33030B B=33030B
### lunacy.mw4
# entries: A=25 B=25 A_only=0 B_only=0 decoded-differ=3
~ missions/lunacy/lunacy.contents A=33574B B=33574B
~ missions/lunacy/lunacy.lights A=74085B B=74085B
~ missions/lunacy/lunacynight.lights A=74085B B=74085B
### nazca.mw4
# entries: A=134 B=134 A_only=0 B_only=0 decoded-differ=3
~ missions/nazca/nazca.contents A=35498B B=35498B
~ missions/nazca/nazca.lights A=189B B=189B
~ missions/nazca/nazcanight.lights A=189B B=189B
### peaks.mw4
# entries: A=129 B=129 A_only=0 B_only=0 decoded-differ=3
~ missions/peaks/peaks.contents A=103198B B=103198B
~ missions/peaks/peaks.lights A=189B B=189B
~ missions/peaks/peaksnight.lights A=189B B=189B
### pgates.mw4
# entries: A=155 B=155 A_only=0 B_only=0 decoded-differ=3
~ missions/palacegates/palacegates.contents A=141158B B=141158B
~ missions/palacegates/palacegates.lights A=74095B B=74095B
~ missions/palacegates/palacegatesnight.lights A=74095B B=74095B
### reduex.mw4
# entries: A=128 B=128 A_only=0 B_only=0 decoded-differ=3
~ missions/reduex/reduex.contents A=183102B B=183102B
~ missions/reduex/reduex.lights A=74081B B=74081B
~ missions/reduex/reduexnight.lights A=98B B=98B
### reduexsiege.mw4
# entries: A=137 B=137 A_only=0 B_only=0 decoded-differ=3
~ missions/reduexsiege/reduexsiege.contents A=225374B B=225374B
~ missions/reduexsiege/reduexsiege.lights A=74081B B=74081B
~ missions/reduexsiege/reduexsiegenight.lights A=98B B=98B
### scarabstronghold.mw4
# entries: A=123 B=123 A_only=0 B_only=0 decoded-differ=3
~ missions/scarabstronghold/scarabstronghold.contents A=45846B B=45846B
~ missions/scarabstronghold/scarabstronghold.lights A=189B B=189B
~ missions/scarabstronghold/scarabstrongholdnight.lights A=98B B=98B
### snowjob.mw4
# entries: A=29 B=29 A_only=0 B_only=0 decoded-differ=3
~ missions/snowjob/snowjob.contents A=19570B B=19570B
~ missions/snowjob/snowjob.lights A=131347B B=131347B
~ missions/snowjob/snowjobnight.lights A=131347B B=131347B
### stormcanyon.mw4
# entries: A=181 B=181 A_only=0 B_only=0 decoded-differ=2
~ missions/stormcanyon/stormcanyon.contents A=96058B B=96058B
~ missions/stormcanyon/stormcanyonnight.lights A=189B B=189B
### stormcanyonsiege.mw4
# entries: A=163 B=163 A_only=0 B_only=0 decoded-differ=2
~ missions/stormcanyonsiege/stormcanyonsiege.contents A=188522B B=188522B
~ missions/stormcanyonsiege/stormcanyonsiegenight.lights A=189B B=189B
### tline.mw4
# entries: A=31 B=31 A_only=0 B_only=0 decoded-differ=3
~ missions/timberline/timberline.contents A=119674B B=119674B
~ missions/timberline/timberline.lights A=131346B B=131346B
~ missions/timberline/timberlinenight.lights A=131346B B=131346B
### tribeincursionmission.mw4
# entries: A=79 B=79 A_only=0 B_only=0 decoded-differ=3
~ missions/tribeincursionmission/tribeincursionmission.contents A=156486B B=156486B
~ missions/tribeincursionmission/tribeincursionmission.lights A=189B B=189B
~ missions/tribeincursionmission/tribeincursionmissionnight.lights A=189B B=189B
### tribeincursion.mw4
# entries: A=71 B=71 A_only=0 B_only=0 decoded-differ=3
~ missions/tribeincursion/tribeincursion.contents A=126646B B=126646B
~ missions/tribeincursion/tribeincursion.lights A=189B B=189B
~ missions/tribeincursion/tribeincursionnight.lights A=189B B=189B