1ef01931fSBen Gras#------------------------------------------------------------------------------ 2*0a6a1f1dSLionel Sambuc# $File: compress,v 1.62 2014/09/13 14:27:12 christos Exp $ 3ef01931fSBen Gras# compress: file(1) magic for pure-compression formats (no archives) 4ef01931fSBen Gras# 5ef01931fSBen Gras# compress, gzip, pack, compact, huf, squeeze, crunch, freeze, yabba, etc. 6ef01931fSBen Gras# 7ef01931fSBen Gras# Formats for various forms of compressed data 8ef01931fSBen Gras# Formats for "compress" proper have been moved into "compress.c", 9ef01931fSBen Gras# because it tries to uncompress it to figure out what's inside. 10ef01931fSBen Gras 11ef01931fSBen Gras# standard unix compress 12ef01931fSBen Gras0 string \037\235 compress'd data 13ef01931fSBen Gras!:mime application/x-compress 14ef01931fSBen Gras!:apple LZIVZIVU 15ef01931fSBen Gras>2 byte&0x80 >0 block compressed 16ef01931fSBen Gras>2 byte&0x1f x %d bits 17ef01931fSBen Gras 18ef01931fSBen Gras# gzip (GNU zip, not to be confused with Info-ZIP or PKWARE zip archiver) 19ef01931fSBen Gras# Edited by Chris Chittleborough <cchittleborough@yahoo.com.au>, March 2002 20ef01931fSBen Gras# * Original filename is only at offset 10 if "extra field" absent 21ef01931fSBen Gras# * Produce shorter output - notably, only report compression methods 22ef01931fSBen Gras# other than 8 ("deflate", the only method defined in RFC 1952). 23ef01931fSBen Gras0 string \037\213 gzip compressed data 24ef01931fSBen Gras!:mime application/x-gzip 25*0a6a1f1dSLionel Sambuc!:strength * 2 26ef01931fSBen Gras>2 byte <8 \b, reserved method 27ef01931fSBen Gras>2 byte >8 \b, unknown method 28ef01931fSBen Gras>3 byte &0x01 \b, ASCII 29ef01931fSBen Gras>3 byte &0x02 \b, has CRC 30ef01931fSBen Gras>3 byte &0x04 \b, extra field 31ef01931fSBen Gras>3 byte&0xC =0x08 32ef01931fSBen Gras>>10 string x \b, was "%s" 33ef01931fSBen Gras>3 byte &0x10 \b, has comment 34*0a6a1f1dSLionel Sambuc>3 byte &0x20 \b, encrypted 35*0a6a1f1dSLionel Sambuc>4 ledate >0 \b, last modified: %s 36*0a6a1f1dSLionel Sambuc>8 byte 2 \b, max compression 37*0a6a1f1dSLionel Sambuc>8 byte 4 \b, max speed 38ef01931fSBen Gras>9 byte =0x00 \b, from FAT filesystem (MS-DOS, OS/2, NT) 39ef01931fSBen Gras>9 byte =0x01 \b, from Amiga 40ef01931fSBen Gras>9 byte =0x02 \b, from VMS 41ef01931fSBen Gras>9 byte =0x03 \b, from Unix 42ef01931fSBen Gras>9 byte =0x04 \b, from VM/CMS 43ef01931fSBen Gras>9 byte =0x05 \b, from Atari 44ef01931fSBen Gras>9 byte =0x06 \b, from HPFS filesystem (OS/2, NT) 45ef01931fSBen Gras>9 byte =0x07 \b, from MacOS 46ef01931fSBen Gras>9 byte =0x08 \b, from Z-System 47ef01931fSBen Gras>9 byte =0x09 \b, from CP/M 48ef01931fSBen Gras>9 byte =0x0A \b, from TOPS/20 49ef01931fSBen Gras>9 byte =0x0B \b, from NTFS filesystem (NT) 50ef01931fSBen Gras>9 byte =0x0C \b, from QDOS 51ef01931fSBen Gras>9 byte =0x0D \b, from Acorn RISCOS 52ef01931fSBen Gras 53ef01931fSBen Gras# packed data, Huffman (minimum redundancy) codes on a byte-by-byte basis 54ef01931fSBen Gras0 string \037\036 packed data 55ef01931fSBen Gras!:mime application/octet-stream 56ef01931fSBen Gras>2 belong >1 \b, %d characters originally 57ef01931fSBen Gras>2 belong =1 \b, %d character originally 58ef01931fSBen Gras# 59ef01931fSBen Gras# This magic number is byte-order-independent. 60ef01931fSBen Gras0 short 0x1f1f old packed data 61ef01931fSBen Gras!:mime application/octet-stream 62ef01931fSBen Gras 63ef01931fSBen Gras# XXX - why *two* entries for "compacted data", one of which is 64ef01931fSBen Gras# byte-order independent, and one of which is byte-order dependent? 65ef01931fSBen Gras# 66ef01931fSBen Gras0 short 0x1fff compacted data 67ef01931fSBen Gras!:mime application/octet-stream 68ef01931fSBen Gras# This string is valid for SunOS (BE) and a matching "short" is listed 69ef01931fSBen Gras# in the Ultrix (LE) magic file. 70ef01931fSBen Gras0 string \377\037 compacted data 71ef01931fSBen Gras!:mime application/octet-stream 72ef01931fSBen Gras0 short 0145405 huf output 73ef01931fSBen Gras!:mime application/octet-stream 74ef01931fSBen Gras 75ef01931fSBen Gras# bzip2 76ef01931fSBen Gras0 string BZh bzip2 compressed data 77ef01931fSBen Gras!:mime application/x-bzip2 78ef01931fSBen Gras>3 byte >47 \b, block size = %c00k 79ef01931fSBen Gras 80ef01931fSBen Gras# lzip 81ef01931fSBen Gras0 string LZIP lzip compressed data 82ef01931fSBen Gras!:mime application/x-lzip 83ef01931fSBen Gras>4 byte x \b, version: %d 84ef01931fSBen Gras 85ef01931fSBen Gras# squeeze and crunch 86ef01931fSBen Gras# Michael Haardt <michael@cantor.informatik.rwth-aachen.de> 87ef01931fSBen Gras0 beshort 0x76FF squeezed data, 88ef01931fSBen Gras>4 string x original name %s 89ef01931fSBen Gras0 beshort 0x76FE crunched data, 90ef01931fSBen Gras>2 string x original name %s 91ef01931fSBen Gras0 beshort 0x76FD LZH compressed data, 92ef01931fSBen Gras>2 string x original name %s 93ef01931fSBen Gras 94ef01931fSBen Gras# Freeze 95ef01931fSBen Gras0 string \037\237 frozen file 2.1 96ef01931fSBen Gras0 string \037\236 frozen file 1.0 (or gzip 0.5) 97ef01931fSBen Gras 98ef01931fSBen Gras# SCO compress -H (LZH) 99ef01931fSBen Gras0 string \037\240 SCO compress -H (LZH) data 100ef01931fSBen Gras 101ef01931fSBen Gras# European GSM 06.10 is a provisional standard for full-rate speech 102ef01931fSBen Gras# transcoding, prI-ETS 300 036, which uses RPE/LTP (residual pulse 103ef01931fSBen Gras# excitation/long term prediction) coding at 13 kbit/s. 104ef01931fSBen Gras# 105ef01931fSBen Gras# There's only a magic nibble (4 bits); that nibble repeats every 33 106ef01931fSBen Gras# bytes. This isn't suited for use, but maybe we can use it someday. 107ef01931fSBen Gras# 108ef01931fSBen Gras# This will cause very short GSM files to be declared as data and 109ef01931fSBen Gras# mismatches to be declared as data too! 110ef01931fSBen Gras#0 byte&0xF0 0xd0 data 111ef01931fSBen Gras#>33 byte&0xF0 0xd0 112ef01931fSBen Gras#>66 byte&0xF0 0xd0 113ef01931fSBen Gras#>99 byte&0xF0 0xd0 114ef01931fSBen Gras#>132 byte&0xF0 0xd0 GSM 06.10 compressed audio 115ef01931fSBen Gras 116ef01931fSBen Gras# bzip a block-sorting file compressor 117ef01931fSBen Gras# by Julian Seward <sewardj@cs.man.ac.uk> and others 118ef01931fSBen Gras# 119ef01931fSBen Gras#0 string BZ bzip compressed data 120ef01931fSBen Gras#>2 byte x \b, version: %c 121ef01931fSBen Gras#>3 string =1 \b, compression block size 100k 122ef01931fSBen Gras#>3 string =2 \b, compression block size 200k 123ef01931fSBen Gras#>3 string =3 \b, compression block size 300k 124ef01931fSBen Gras#>3 string =4 \b, compression block size 400k 125ef01931fSBen Gras#>3 string =5 \b, compression block size 500k 126ef01931fSBen Gras#>3 string =6 \b, compression block size 600k 127ef01931fSBen Gras#>3 string =7 \b, compression block size 700k 128ef01931fSBen Gras#>3 string =8 \b, compression block size 800k 129ef01931fSBen Gras#>3 string =9 \b, compression block size 900k 130ef01931fSBen Gras 131ef01931fSBen Gras# lzop from <markus.oberhumer@jk.uni-linz.ac.at> 132ef01931fSBen Gras0 string \x89\x4c\x5a\x4f\x00\x0d\x0a\x1a\x0a lzop compressed data 133ef01931fSBen Gras>9 beshort <0x0940 134ef01931fSBen Gras>>9 byte&0xf0 =0x00 - version 0. 135ef01931fSBen Gras>>9 beshort&0x0fff x \b%03x, 136ef01931fSBen Gras>>13 byte 1 LZO1X-1, 137ef01931fSBen Gras>>13 byte 2 LZO1X-1(15), 138ef01931fSBen Gras>>13 byte 3 LZO1X-999, 139ef01931fSBen Gras## >>22 bedate >0 last modified: %s, 140ef01931fSBen Gras>>14 byte =0x00 os: MS-DOS 141ef01931fSBen Gras>>14 byte =0x01 os: Amiga 142ef01931fSBen Gras>>14 byte =0x02 os: VMS 143ef01931fSBen Gras>>14 byte =0x03 os: Unix 144ef01931fSBen Gras>>14 byte =0x05 os: Atari 145ef01931fSBen Gras>>14 byte =0x06 os: OS/2 146ef01931fSBen Gras>>14 byte =0x07 os: MacOS 147ef01931fSBen Gras>>14 byte =0x0A os: Tops/20 148ef01931fSBen Gras>>14 byte =0x0B os: WinNT 149ef01931fSBen Gras>>14 byte =0x0E os: Win32 150ef01931fSBen Gras>9 beshort >0x0939 151ef01931fSBen Gras>>9 byte&0xf0 =0x00 - version 0. 152ef01931fSBen Gras>>9 byte&0xf0 =0x10 - version 1. 153ef01931fSBen Gras>>9 byte&0xf0 =0x20 - version 2. 154ef01931fSBen Gras>>9 beshort&0x0fff x \b%03x, 155ef01931fSBen Gras>>15 byte 1 LZO1X-1, 156ef01931fSBen Gras>>15 byte 2 LZO1X-1(15), 157ef01931fSBen Gras>>15 byte 3 LZO1X-999, 158ef01931fSBen Gras## >>25 bedate >0 last modified: %s, 159ef01931fSBen Gras>>17 byte =0x00 os: MS-DOS 160ef01931fSBen Gras>>17 byte =0x01 os: Amiga 161ef01931fSBen Gras>>17 byte =0x02 os: VMS 162ef01931fSBen Gras>>17 byte =0x03 os: Unix 163ef01931fSBen Gras>>17 byte =0x05 os: Atari 164ef01931fSBen Gras>>17 byte =0x06 os: OS/2 165ef01931fSBen Gras>>17 byte =0x07 os: MacOS 166ef01931fSBen Gras>>17 byte =0x0A os: Tops/20 167ef01931fSBen Gras>>17 byte =0x0B os: WinNT 168ef01931fSBen Gras>>17 byte =0x0E os: Win32 169ef01931fSBen Gras 170ef01931fSBen Gras# 4.3BSD-Quasijarus Strong Compression 171ef01931fSBen Gras# http://minnie.tuhs.org/Quasijarus/compress.html 172ef01931fSBen Gras0 string \037\241 Quasijarus strong compressed data 173ef01931fSBen Gras 174ef01931fSBen Gras# From: Cory Dikkers <cdikkers@swbell.net> 175ef01931fSBen Gras0 string XPKF Amiga xpkf.library compressed data 176ef01931fSBen Gras0 string PP11 Power Packer 1.1 compressed data 177ef01931fSBen Gras0 string PP20 Power Packer 2.0 compressed data, 178ef01931fSBen Gras>4 belong 0x09090909 fast compression 179ef01931fSBen Gras>4 belong 0x090A0A0A mediocre compression 180ef01931fSBen Gras>4 belong 0x090A0B0B good compression 181ef01931fSBen Gras>4 belong 0x090A0C0C very good compression 182ef01931fSBen Gras>4 belong 0x090A0C0D best compression 183ef01931fSBen Gras 184ef01931fSBen Gras# 7-zip archiver, from Thomas Klausner (wiz@danbala.tuwien.ac.at) 185ef01931fSBen Gras# http://www.7-zip.org or DOC/7zFormat.txt 186ef01931fSBen Gras# 187ef01931fSBen Gras0 string 7z\274\257\047\034 7-zip archive data, 188ef01931fSBen Gras>6 byte x version %d 189ef01931fSBen Gras>7 byte x \b.%d 190835f6802SDirk Vogt!:mime application/x-7z-compressed 191ef01931fSBen Gras 192ef01931fSBen Gras# Type: LZMA 19308ff44c4SLionel Sambuc0 lelong&0xffffff =0x5d 194*0a6a1f1dSLionel Sambuc>12 leshort 0xff LZMA compressed data, 195*0a6a1f1dSLionel Sambuc!:mime application/x-lzma 19608ff44c4SLionel Sambuc>>5 lequad =0xffffffffffffffff streamed 19708ff44c4SLionel Sambuc>>5 lequad !0xffffffffffffffff non-streamed, size %lld 198*0a6a1f1dSLionel Sambuc>12 leshort 0 LZMA compressed data, 199*0a6a1f1dSLionel Sambuc>>5 lequad =0xffffffffffffffff streamed 200*0a6a1f1dSLionel Sambuc>>5 lequad !0xffffffffffffffff non-streamed, size %lld 201ef01931fSBen Gras 202ef01931fSBen Gras# http://tukaani.org/xz/xz-file-format.txt 203835f6802SDirk Vogt0 ustring \xFD7zXZ\x00 XZ compressed data 204ef01931fSBen Gras!:mime application/x-xz 205ef01931fSBen Gras 206835f6802SDirk Vogt# https://github.com/ckolivas/lrzip/blob/master/doc/magic.header.txt 207835f6802SDirk Vogt0 string LRZI LRZIP compressed data 208835f6802SDirk Vogt>4 byte x - version %d 209835f6802SDirk Vogt>5 byte x \b.%d 210835f6802SDirk Vogt!:mime application/x-lrzip 211835f6802SDirk Vogt 212*0a6a1f1dSLionel Sambuc# http://fastcompression.blogspot.fi/2013/04/lz4-streaming-format-final.html 213*0a6a1f1dSLionel Sambuc0 lelong 0x184d2204 LZ4 compressed data (v1.4+) 214*0a6a1f1dSLionel Sambuc!:mime application/x-lz4 215*0a6a1f1dSLionel Sambuc# Added by osm0sis@xda-developers.com 216*0a6a1f1dSLionel Sambuc0 lelong 0x184c2103 LZ4 compressed data (v1.0-v1.3) 217*0a6a1f1dSLionel Sambuc!:mime application/x-lz4 218*0a6a1f1dSLionel Sambuc0 lelong 0x184c2102 LZ4 compressed data (v0.1-v0.9) 219*0a6a1f1dSLionel Sambuc!:mime application/x-lz4 220*0a6a1f1dSLionel Sambuc 221ef01931fSBen Gras# AFX compressed files (Wolfram Kleff) 222ef01931fSBen Gras2 string -afx- AFX compressed file data 223ef01931fSBen Gras 224ef01931fSBen Gras# Supplementary magic data for the file(1) command to support 225ef01931fSBen Gras# rzip(1). The format is described in magic(5). 226ef01931fSBen Gras# 227ef01931fSBen Gras# Copyright (C) 2003 by Andrew Tridgell. You may do whatever you want with 228ef01931fSBen Gras# this file. 229ef01931fSBen Gras# 230ef01931fSBen Gras0 string RZIP rzip compressed data 231ef01931fSBen Gras>4 byte x - version %d 232ef01931fSBen Gras>5 byte x \b.%d 233ef01931fSBen Gras>6 belong x (%d bytes) 234ef01931fSBen Gras 235835f6802SDirk Vogt0 string ArC\x01 FreeArc archive <http://freearc.org> 236835f6802SDirk Vogt 237835f6802SDirk Vogt# Type: DACT compressed files 238835f6802SDirk Vogt0 long 0x444354C3 DACT compressed data 239835f6802SDirk Vogt>4 byte >-1 (version %i. 240835f6802SDirk Vogt>5 byte >-1 %i. 241835f6802SDirk Vogt>6 byte >-1 %i) 242835f6802SDirk Vogt>7 long >0 , original size: %i bytes 243835f6802SDirk Vogt>15 long >30 , block size: %i bytes 244*0a6a1f1dSLionel Sambuc 245*0a6a1f1dSLionel Sambuc# Valve Pack (VPK) files 246*0a6a1f1dSLionel Sambuc0 lelong 0x55aa1234 Valve Pak file 247*0a6a1f1dSLionel Sambuc>0x4 lelong x \b, version %u 248*0a6a1f1dSLionel Sambuc>0x8 lelong x \b, %u entries 249*0a6a1f1dSLionel Sambuc 250*0a6a1f1dSLionel Sambuc# Snappy framing format 251*0a6a1f1dSLionel Sambuc# http://code.google.com/p/snappy/source/browse/trunk/framing_format.txt 252*0a6a1f1dSLionel Sambuc0 string \377\006\0\0sNaPpY snappy framed data 253*0a6a1f1dSLionel Sambuc!:mime application/x-snappy-framed 254*0a6a1f1dSLionel Sambuc 255*0a6a1f1dSLionel Sambuc# qpress, http://www.quicklz.com/ 256*0a6a1f1dSLionel Sambuc0 string qpress10 qpress compressed data 257*0a6a1f1dSLionel Sambuc!:mime application/x-qpress 258*0a6a1f1dSLionel Sambuc 259*0a6a1f1dSLionel Sambuc# Zlib https://www.ietf.org/rfc/rfc6713.txt 260*0a6a1f1dSLionel Sambuc0 beshort%31 =0 261*0a6a1f1dSLionel Sambuc>0 byte&0xf =8 262*0a6a1f1dSLionel Sambuc>>0 byte&0x80 =0 zlib compressed data 263*0a6a1f1dSLionel Sambuc!:mime application/zlib 264