Development: Formats/IT

General information concerning the IT file format. Any variable names in this document refer to the original variable names from ITTECH.TXT. Variable names and hexadecimal numbers (in little-endian formats) are indicated by a monospace font.

Note: Impulse tracker is now open source! You can grab the source code at GitHub.

Tracker IDs

The IT header contains a field, Cwt/v, which is used to identify the application that was used to create the file. The following custom tracker IDs (read as little-endian hexadecimal numbers) are known to be found in the Cwt/v field:

• 0xyy - Impulse Tracker x.yy - Many other trackers, like ModPlug Tracker, disguise as various versions of Impulse Tracker, so this is not a reliable way to tell if a file was really made with Impulse Tracker. See below for detecting such trackers.
• 1xyy - Schism Tracker x.yy up to Schism Tracker v0.50, later versions encode a timestamp in the version number - see Schism Tracker’s version.c or OpenMPT’s Load_it.cpp for a version not relying on the C runtime library (since localtime is not guaranteed to be thread-safe).
• 4xyy - pyIT x.yy
• 5xyy - OpenMPT x.yy - lower two bytes of version number are stored in the "reserved" header field starting from OpenMPT 1.29.10.00 in compatible mode (otherwise OpenMPT song extensions are used as before).
• 6xyy - BeRoTracker x.yy
• 7xyz - ITMCK x.y.z (N.B. the user can override the value of the Cwt/v header by the -w command-line switch or the #TRACKER-VERSION command in the input file)
• 7FFF, Cmwt = 0215: munch.py
• 8xyy - Tralala x.yy; prealpha versions, built from svn, before the first release identify as version 0.00 (i.e. Cwt/v=8000)
• Cxyy - ChickDune ChipTune Tracker x.yy (currently non-public alpha version)
• DAEB - spc2it (after commit d3d1b524032f668be8ee20d25339e1c635fb9bcf)

Are you a tracker developer and you tracker can save IT files? Please add your Tracker ID to this list!

Once we run out of tracker IDs, a more sophisticated approach will have to be found. For example, the ID 0FFF could be reserved, and a pointer to extended tracker information could be placed in the reserved header field.

Detecting other trackers

Some trackers disguise as Impulse Tracker 2, but there are ways to uncover this diguise:

BeRoTracker

Earlier versions of BeRoTracker, which did not use the tracker ID described above, can be identified by the four byte MODU magic which can be found after the Edit History / MIDI Macro / ModPlug extension block. Cwt/v is 0217 and Cmwt is 0214 or 0200 (overlaps with ModPlug Tracker). The edit history flag is set and there are always 0 entries in the edit history.

CheeseTracker

• Cwt/v and Cmwt are both 0214
• Instrument mode flag is always set. The only other flags that can be optionally set are: Stereo Mode, Linear Slides, Old Effects, Compatible Gxx.
• The only special flag ever set is the song message flag (even though row highlights are always written).
• reserved is 0
• All sample and instrument filenames read XXXXXXXX.YYY (obviously this should not be used as a stand-alone detection criterion, as files re-saved with other trackers will still use these filenames).

ChibiTracker

Cwt/v and Cmwt are both 0214, reserved reads CHBI.

Further interesting criteria: Sample data is stored directly after header. All sample and instrument filenames read -DEPRECATED- (obviously this should not be used as a stand-alone detection criterion, as files re-saved with other trackers will still use these filenames). ChibiTracker also uses a line feed character (0A or \n) instead of a carriage return (0D or \r) in the song message.

ModPlug Tracker

• ModPlug Tracker 1.0 pre-alpha 4 (and possibly earlier) - 1.0 alpha 4: Cwt/v is 0202, Cmwt is 0200, reserved is 0, row highlights are both 0. These attributes alone are not enough to fingerprint these ModPlug Tracker versions, but luckily it also stores the remaining data in a very peculiar order: patterns first, then instrument headers, and then interleaves sample headers and their corresponding sample data. These versions also do not optimize empty 64-row patterns with a 0 parapointer, so they can be identified by checking if the first pattern parapointer is not 0 and less than the first sample parapointer.
• ModPlug Tracker 1.0 alpha 5: Cwt/v is 0214, Cmwt is 0200, reserved is 0. Pattern highlights and edit history flags are not set. Instruments are 560 bytes apart.
• ModPlug Tracker 1.0 alpha 6 / beta 1 / beta 2: Cwt/v is 0214, Cmwt is 0200, reserved is 0. Pattern highlights and edit history flags are set. Instruments are 560 bytes apart up to and including beta 1, in beta 2 they are 557 bytes apart.
• ModPlug Tracker 1.0 beta 3.2 - 1.07: Cwt/v is 0214, Cmwt is 0202, reserved is 0. Instruments are 557 bytes apart.
• Newer versions of ModPlug Tracker, OpenMPT 1.17 in compatible mode: Cwt/v is 0217, Cmwt is 0200, reserved is 0. If there are any instruments in the file, the instrument TrkVers field is 0211 for ModPlug Tracker and 0220 for OpenMPT. ModPlug Tracker writes FF for unused channels in the panning map, OpenMPT never does this. When an IT file uses all 64 channels (so the panning map cannot be used for distinction), the presence of ModPlug extensions (channel names, plugin chunks, etc.) can help telling MPT 1.16 and OpenMPT 1.17 compatibility export apart. The latter also does not save a final "---" oder list item, while MPT 1.16 does.

OpenMPT

• OpenMPT 1.17.02.20 to OpenMPT 1.17.02.25 wrote the value 0300 in both the Cwt/v and Cmwt fields.
• OpenMPT 1.17.02.26 to OpenMPT 1.18 wrote the value 0888 in both the Cwt/v and Cmwt fields.
• Later versions of OpenMPT use the tracker ID provided above. In that case, the reserved field reads OMPT if the file was saved in normal mode, and is 0 (or the lower two bytes of version information starting from OpenMPT 1.29.10.00) if it was saved in compatible mode.

OpenSPC conversions

OpenSPC is a tool to convert SNES music from the SPC format to the IT format. If all the following conditions are true, you can be fairly sure that a module was written with OpenSPC:

• Cwt/v is 0214.
• Cmwt is 0200.
• Flags is 09 (Linear Slides, Stereo Playback).
• Special is 0.
• Both pattern highlight values are 00.
• No instruments are used.
• PatNum + 1 == OrdNum.
• Global volume is 128 decimal.
• Master volume is 100 decimal.
• Initial Speed is 1.
• Pan Separation is 128 decimal.
• Pitch wheel depth is 0.
• There is no song message, i.e. message length and offset are 0.
• reserved is 0.

Earlier versions of spc2it (before commit d3d1b524032f668be8ee20d25339e1c635fb9bcf) will be mis-identified as OpenSPC, as the tool closely follows the way its predecessor writes out IT files.

Unknown XM to IT conversion tool

There is a currently unknown XM to IT conversion tool which can be identified easily by the fact that it writes unsigned samples (which was the default only until Impulse Tracker 2.01). However, only sample slots with actual sample data should be considered for this test, as re-saving such a file in Impulse Tracker will not reset the unsigned flag for empty slots. If the following conditions are true, you can be fairly sure that a module was written with the unknown converter:

• Cwt/v is 0204.
• Cmwt is 0200.
• Flags: Stereo Playback, Instrument Mode, Old Effects are always set, Linear Slides are optional.
• Special is 0.
• Both pattern highlight values are 0.
• Global volume is 128 decimal.
• Master volume is 48 decimal.
• Pan Separation is 128 decimal.
• Pitch wheel depth is 0.
• There is no song message, i.e. message length and offset are 0.
• reserved is 0.
• Song title is no longer than 20 characters.
• All channels are panned centre (32) or muted, and their volume is 64 decimal.

To be extra sure, you can check all of these properties, but just checking Cwt/v, Cmwt and unsigned sample data is probably enough.

UNMO3

UNMO3 is a tool to convert an MO3-compressed module file back into its original format.

In IT files created with UNMO3, the following are always true:

• Cwt/v and Cmwt are 0214
• reserved is 0
• pwd is 0
• Both row highlights are 0
• Flags: Use MIDI Pitch Controller (bit 6) and Request embedded MIDI configuration (bit 7) are never set

This partially overlaps with Impulse Tracker 2.14 and CheeseTracker fingerprints, however:

• CheeseTracker should write non-zero row highlights, even when resaving an UNMO3-ed file.
• It is highly unlikely that Impulse Tracker 2.14 writes a reserved value of 0. If it writes zero row highlights, the row highlight special flag is set.
• Impulse Tracker 2.14 never writes an empty edit history (see below).
• CheeseTracker always uses instrument mode.

Some older versions of UNMO3 write out IT files that are malformed in some way or another, but it is easy to detect and work around. Some UNMO3-ed IT files are floating around in the wild, so it may be worthwile to implement those work-arounds:

Special flags prior UNMO3 2.4.0.2

• UNMO3 2.4 (released in 2008) and older sets the special flag bits 1 (edit history) and 2 (row highlights) whenever bit 3 (MIDI macros) is set as well.
• UNMO3 2.4.0.1 (January 2011) always sets the special flag bit 1 (edit history), but the behaviour for bit 2 (row highlights) remains as in previous versions.
• UNMO3 2.4.0.2 (July 2011) never sets the row highlights flag.

Sample mode prior to UNMO3 2.4.0.1

UNMO3 2.4 and older reserves space for the instrument parapointers (as many as there are samples) even when the IT file is in sample mode. This can be detected by the fact that 4 * SmpNum zero bytes follow after the pattern parapointers. These bytes need to be skipped in order to be able to read MIDI macros and ModPlug plugin settings which may potentially follow.

UNMO3 2.4.0.1 fixes this problem.

Edit History prior to UNMO3 2.4.0.1

As mentioned above, UNMO3 older than version 2.4.0.1 may or may not set the edit history flag, but they always write two edit history length bytes (zeroes) in the file anyway. Keep this in mind, as MIDI Macros and ModPlug plugin settings will not load properly if you don’t.

• Edit history flag is set: Nothing needs to be done. We can still use this for identifying UNMO3-saved IT files, because Impulse Tracker never writes an edit history of length 0.
• Edit history flag is not set: This is the troublesome case due to MIDI macros and plugin settings. However, a reliable way to detect such malformed IT files would be to try to read the edit history length if all of the above detection criteria for UNMO3 are fulfilled. For those old UNMO3 versions, you should read two zero bytes. If that is the case, it means that the first MIDI macro would be empty (if MIDI macros are embedded) or the first plugin chunk ID starts with two zero bytes (impossible). Since UNMO3 writes out default values for the nine global MIDI macros, the first MIDI macro would have to start with “FF” (MIDI Start) and not be empty, so it is clear that the two zero bytes belong to the (empty) edit history.

Later version of UNMO3 set the correct header flag for the edit history and write the two zero length bytes.

Special Header Flags

The following "Special" flags are not documented:

• Bit 1 (02): If set, edit history information (see below) is present.
• Bit 2 (04): If set, the row highlights (at offset 1E - 1F) should be read. If not set, they should be ignored.

Edit History

It is little known that the latest versions of Impulse Tracker keep track of when an IT file is opened and how long it is left open. The edit history can be found directly after the IT header and before the possibly present MIDI macro configuration.

A 16-Bit integer num tells how many edit history blocks are present. Every block is 8 bytes long, so the 16-bit integer is followed by 8 * num bytes of edit history information.

Each history block consists of a 16-Bit FAT date, a 16-Bit FAT time and a 32-Bit DOS timer, which contains the time how long the file was open in the editor, in 1/18.2th seconds. Information on how to decode the FAT date and time stamps can be found on the MSDN.

Note: Many programs don’t write an edit history, but they set the edit history flag in the header and write the two zero bytes for the history length. Many of them also ignore the edit history flag when loading files and always read the two num num bytes (ignoring the special flag), so if you want to write out an IT file that does not have an edit history and do not mind about the two extra bytes, the safest (most compatible) way is to set the edit history flag and write two zero bytes for num.

Also note that none of this is really relevant if you are sure that you never write out the MIDI macro configuration or ModPlug extensions, since these are the only two things that could normally follow the edit history. So if you have no MIDI macros and no ModPlug extensions, it is always safe to not set the special flag and not write the two extra bytes.

Edit Timer

Before the addition of the full Edit History, a simple Edit Timer was stored in the reserved field of the file header. Starting from Impulse Tracker 2.07, this field contains the total edit time as a 32-Bit DOS timer (same resolution as in the Edit History). Starting from Impulse Tracker 2.08, the timer is encrypted. To decrypt:

editTime = editTime XOR 'ITRK'
editTime = editTime RoR 7
editTime = -editTime
editTime = editTime RoL 4
editTime = editTime XOR 'JTHL'

Proposed way to store compressed stereo samples

Since Impulse Tracker itself does not support stereo samples, a common way of how to decode compressed stereo samples had to be found - After all, it is possible to just treat them as one continuous stream (not stopping the encoding / decoding process after the end of the left channel), or to treat them as two separate, consecutive streams. XMPlay was probably the only player that could handle compressed stereo samples even before there was a single implementation for saving compressed stereo samples. GreaseMonkey has decided to follow XMPlay's way of decoding compressed stereo samples by treating them as two streams of the same length, so OpenMPT follows this example. If you intend to add IT sample compression support in your application, you should do the same to ensure compatibility across as many applications as possible.

OpenMPT Hacks

For a list of all the file format hacks that ModPlug Tracker / OpenMPT added to the IT format over the years, see the OpenMPT Format Extensions article.