Changes in python

a77ebd868432a4d7e595fb7709cfc1b8f144789b - Import file-5.43+; last was file-5.40

Sat, 24 Sep 2022 20:07:53 +0000

Import file-5.43+; last was file-5.402022-09-20 17:12 Christos Zoulas * fixed various clustefuzz issues2022-09-19 15:54 Christos Zoulas * Fix error detection for decompression code (Vincent Mihalkovic)2022-09-15 13:50 Christos Zoulas * Add MAGIC_NO_COMPRESS_FORK and use it to produce a more meaningful error message if we are sandboxing.2022-09-15 10:45 Christos Zoulas * Add built-in lzip decompression support (Michal Gorny)2022-09-14 10:35 Christos Zoulas * Add built-in zstd decompression support (Martin Rodriguez Reboredo)2022-09-13 14:55 Christos Zoulas * release 5.432022-09-10 9:17 Christos Zoulas * Add octal indirect magic (Michal Gorny)2022-08-17 11:43 Christos Zoulas * PR/374: avoid infinite loop in non-wide code (piru) * PR/373: Obey MAGIC_CONTINUE with multiple magic files (vismarli)2022-07-26 11:10 Christos Zoulas * Fix bug with large flist (Florian Weimer)2022-07-07 13:21 Christos Zoulas * PR/364: Detect non-nul-terminated core filenames from QEMU (mam-ableton)2022-07-04 15:45 Christos Zoulas * PR/359: Add support for http://ndjson.org/ (darose) * PR/362: Fix wide printing (ro-ee) * PR/358: Fix width for -f - (jpalus) * PR/356: Fix JSON constant parsing (davewhite)2022-06-10 9:40 Christos Zoulas * release 5.422022-05-31 14:50 Christos Zoulas * PR/348: add missing cases to prevent file from aborting on random magic files.2022-05-27 21:05 Christos Zoulas * PR/351: octalify filenames when not raw before printing.2022-04-18 17:51 Christos Zoulas * fix regex cacheing bug (Dirk Mueller) * merge file_regcomp and file_regerror() to simplify the code and reduce memory requirements for storing regexes (Dirk Mueller)2022-03-19 12:56 Christos Zoulas * cache regex (Dirk Mueller) * detect filesystem full by flushing output (Dirk Mueller)2021-11-19 12:36 Christos Zoulas * implement running decompressor programs using posix_spawnp(2) instead of vfork(2)2021-10-24 11:51 Christos Zoulas * Add support for msdos dates and times2021-10-20 9:55 Christos Zoulas * use the system byte swapping functions if available (Werner Fink)2021-10-18 11:57 Christos Zoulas * release 5.412021-09-23 03:51 Christos Zoulas * Avinash Sonawane: Fix tzname detection2021-09-03 09:17 Christos Zoulas * Fix relationship tests with "search" magic, don't short circuit logic2021-07-13 01:06 Christos Zoulas * Fix memory leak in compile mode2021-07-01 03:51 Christos Zoulas * PR/272: kiefermat: Only set returnval = 1 when we printed something (in all cases print or !print). This simplifies the logic and fixes the issue in the PR with -k and --mime-type there was no continuation printed before the default case.2021-06-30 13:07 Christos Zoulas * PR/270: Don't translate unprintable characters in %s magic formats when -r * PR/269: Avoid undefined behavior with clang (adding offset to NULL)2021-05-09 18:38 Christos Zoulas * Add a new flag (f) that requires that the match is a full word, not a partial word match. * Add varint types (unused)2021-04-19 17:17 Christos Zoulas * PR/256: mutableVoid: If the file is less than 3 bytes, use the file length to determine type * PR/259: aleksandr.v.novichkov: mime printing through indirect magic is not taken into account, use match directly so that it does.2021-04-04 17:02 Christos Zoulas * count the total bytes found not the total byte positions in order to determine encoding (Anatol Belski) List of files: /netbsd-src/external/bsd/file/dist/magic/magdir/python

03c288bb80f87355b71b861c24c4a5a7d092d978 - Import 5.39:

Mon, 15 Jun 2020 00:18:47 +0000

Import 5.39: * Remove unused subtype_mime (Steve Grubb) * Remove unused check in okstat (Steve Grubb) * Fix mime-type in elf binaries by making sure $x is set * Fix indirect negative offsets broken by OFFNEGATIVE * Fix GUID equality check * PR/165: Handle empty array and strings in JSON * PR/162: Add --exclude-quiet * Fix memory leak in ascmagic (Steve Grubb) * Fix string comparison length with ignore whitespace * Fix mingwin 64 compilation * PR/159: whitelist getpid needed for file_pipe2file() * Indicate negative offsets with a flag OFFNEGATIVE so that -0 works. * Introduce "offset" magic type that can be used to detect the file size, and bail on short files. * document DER better in the magic man page. * fix memory leaks (SonarQube) * rewrite confusing loops (SonarQube) * fix bogus test (SonarQube) * pass a sized buffer to file_fmttime() (SonarQube) * Don't allow * in printf formats, or the code itself (Christoph Biedl) * Introduce a printf output size checker to avoid DoS attacks * Avoid memory leak on error (oss-fuzz) * Check length of string on DER before derefercing and add new types * Add missing DER string (oss-fuzz) * Add missing DER types, and debugging * PR/140: Avoid abort with hand-crafted magic file (gockelhahn) * PR/139: Avoid DoS in printf with hand-crafted magic file (gockelhahn) * PR/138: Avoid crash with hand-crafted magic file (gockelhahn) * PR/136: Fix static build by adding a libmagic.pc (Fabrice Fontaine) * add guid support native support via the "guid" type. List of files: /netbsd-src/external/bsd/file/dist/magic/magdir/python

eff51ed2363290913a5045493181556dca3d7b10 - Import 5.38:

Tue, 17 Dec 2019 02:23:53 +0000

Import 5.38: - Always accept -S (no sandbox) even if we don't support sandboxing - More syscalls elided for sandboxiing - For ELF dynamic means having an interpreter not just PT_DYNAMIC - Check for large ELF session header offset - When saving and restoring a locale, keep the locale name in our own storage. - Add a flag to disable CSV file detection. - Don't pass NULL/0 to memset to appease sanitizers. - Avoid spurious prints when looks for extensions or apple strings in fsmagic. - Add builtin decompressors for xz and and bzip. - Add a limit for the number of CDF elements. - More checks for overflow in CDF. List of files: /netbsd-src/external/bsd/file/dist/magic/magdir/python

dc958920d95b669c2a61806f127b489440aee7e5 - 2019-05-14 22:26 Christos Zoulas

Wed, 22 May 2019 17:19:56 +0000

2019-05-14 22:26 Christos Zoulas * release 5.372019-05-09 22:27 Christos Zoulas * Make sure that continuation separators are printed with -k within softmagic2019-05-06 22:27 Christos Zoulas * Change SIGPIPE saving and restoring during compression to use sigaction(2) instead of signal(3) and cache it. (Denys Vlasenko) * Cache stat(2) calls more to reduce number of calls (Denys Vlasenko)2019-05-06 17:25 Christos Zoulas * PR/77: Handle --mime-type and -k correctly.2019-05-03 15:26 Christos Zoulas * Switch decompression code to use vfork() because tools like rpmdiff and rpmbuild call libmagic with large process footprints (Denys Vlasenko)2019-04-07 14:05 Christos Zoulas * PR/75: --enable-zlib, did not work.2019-02-27 11:54 Christos Zoulas * Improve regex efficiency (Michael Schroeder) by: 1. Prefixing regex searches with regular search for keywords where possible 2. Using memmem(3) where available List of files: /netbsd-src/external/bsd/file/dist/magic/magdir/python

41da50d881c0c84142a6052b73efb740a0a0132e - 2017-09-02 11:53 Christos Zoulas

Fri, 08 Sep 2017 13:22:41 +0000

2017-09-02 11:53 Christos Zoulas * release 5.322017-08-28 16:37 Christos Zoulas * Always reset state in {file,buffer}_apprentice (Krzysztof Wilczynski)2017-08-27 03:55 Christos Zoulas * Fix always true condition (Thomas Jarosch)2017-05-24 17:30 Christos Zoulas * pickier parsing of numeric values in magic files.2017-05-23 17:55 Christos Zoulas * PR/615 add magic_getflags()2017-05-23 13:55 Christos Zoulas * release 5.312017-03-17 20:32 Christos Zoulas * remove trailing spaces from magic files * refactor is_tar * better bounds checks for cdf List of files: /netbsd-src/external/bsd/file/dist/magic/magdir/python

008b33e8a4b94359a7a27a82271dd77da780b44b - Import file-5.31; mostly oss-fuzz found bugs.

Wed, 24 May 2017 23:59:56 +0000

Import file-5.31; mostly oss-fuzz found bugs. List of files: /netbsd-src/external/bsd/file/dist/magic/magdir/python

ae9cfef6efbfdbc6957a4e67509e24fe18e50445 - 2017-02-10 12:24 Christos Zoulas

Fri, 10 Feb 2017 17:42:56 +0000

2017-02-10 12:24 Christos Zoulas * release 5.302017-02-07 23:27 Christos Zoulas * If we exceeded the offset in a search return no match (Christoph Biedl) * Be more lenient on corrupt CDF files (Christoph Biedl)2017-02-04 16:46 Christos Zoulas * pacify ubsan sign extension (oss-fuzz/524)2017-02-01 12:42 Christos Zoulas * off by one in cdf parsing (PR/593) * report debugging sections in elf (PR/591)2016-11-06 10:52 Christos Zoulas * Allow @@@ in extensions * Add missing overflow check in der magic (Jonas Wagner)2016-10-25 10:40 Christos Zoulas * release 5.292016-10-24 11:20 Christos Zoulas * der getlength overflow (Jonas Wagner) * multiple magic file load failure (Christoph Biedl)2016-10-17 11:26 Christos Zoulas * CDF parsing improvements (Guy Helmer)2016-07-20 7:26 Christos Zoulas * Add support for signed indirect offsets2016-07-18 7:41 Christos Zoulas * cat /dev/null | file - should print empty (Christoph Biedl)2016-07-05 15:20 Christos Zoulas * Bump string size from 64 to 96.2016-06-13 20:20 Christos Zoulas * PR/556: Fix separators on annotations.2016-06-13 19:40 Christos Zoulas * release 5.28 * fix leak on allocation failure2016-06-01 1:20 Christos Zoulas * PR/555: Avoid overflow for offset > nbytes * PR/550: Segv on DER parsing: - use the correct variable for length - set offset to 0 on failure.2016-05-13 12:00 Christos Zoulas * release 5.272016-04-18 9:35 Christos Zoulas * Errors comparing DER entries or computing offsets are just indications of malformed non-DER files. Don't print them. * Offset comparison was off-by-one. * Fix compression code (Werner Fink) * Put new bytes constant in the right file (not the generated one)2016-04-16 18:34 Christos Zoulas * release 5.262016-03-31 13:50 Christos Zoulas * make the number of bytes read from files configurable.2016-03-21 13:40 Christos Zoulas * Add bounds checks for DER code (discovered by Thomas Jarosch) * Change indirect recursion limit to indirect use count and bump from 15 to 50 to prevent abuse.2016-03-13 20:39 Christos Zoulas * Add -00 which prints filename\0description\02016-03-01 13:28 Christos Zoulas * Fix ID3 indirect parsing2016-01-19 10:18 Christos Zoulas * add DER parsing capability2015-11-13 10:35 Christos Zoulas * provide dprintf(3) for the OS's that don't have it.2015-11-11 16:25 Christos Zoulas * redo the compression code report decompression errors2015-11-10 23:25 Christos Zoulas * REG_STARTEND code is not working as expected, delete it.2015-11-09 16:05 Christos Zoulas * Add zlib support if we have it.2015-11-05 11:22 Christos Zoulas * PR/492: compression forking was broken with magic_buffer.2015-09-16 9:50 Christos Zoulas * release 5.252015-09-11 13:25 Christos Zoulas * add a limit to the length of regex searches2015-09-08 9:50 Christos Zoulas * fix problems with --parameter (Christoph Biedl)2015-07-11 10:35 Christos Zoulas * Windows fixes PR/466 (Jason Hood)2015-07-09 10:35 Christos Zoulas * release 5.242015-06-11 8:52 Christos Zoulas * redo long option encoding to fix off-by-one in 5.232015-06-10 13:50 Christos Zoulas * release 5.232015-06-09 16:10 Christos Zoulas * Fix issue with regex range for magic with offset * Always return true from mget with USE (success to mget not match indication). Fixes mime evaluation after USE magic * PR/459: Don't insert magic entries to the list if there are parsing errors for them.2015-06-03 16:00 Christos Zoulas * PR/455: Add utf-7 encoding2015-06-03 14:30 Christos Zoulas * PR/455: Implement -Z, look inside, but don't report on compression * PR/454: Fix allocation error on bad magic.2015-05-29 10:30 Christos Zoulas * handle MAGIC_CONTINUE everywhere, not just in softmagic2015-05-21 14:30 Christos Zoulas * don't print descriptions for NAME types when mime.2015-04-09 15:59 Christos Zoulas * Add --extension to list the known extensions for this file type Idea by Andrew J Roazen2015-02-14 12:23 Christos Zoulas * Bump file search buffer size to 1M.2015-01-09 14:35 Christos Zoulas * Fix multiple issues with date formats reported by Christoph Biedl: - T_LOCAL meaning was reversed - Arithmetic did not work Also stop adjusting daylight savings for gmt printing.2015-01-05 13:00 Christos Zoulas * PR/411: Fix memory corruption from corrupt cdf file. List of files: /netbsd-src/external/bsd/file/dist/magic/magdir/python

ebfd11214ddcf9812e0491c373b29e7de34772e6 - import file-5.20; bug fixes and better image magic descriptions.

Fri, 10 Oct 2014 20:08:15 +0000

import file-5.20; bug fixes and better image magic descriptions. List of files: /netbsd-src/external/bsd/file/dist/magic/magdir/python

012fd1339dda98ae40e47a982fc6b6bc1fa14970 - import file-5.19

Fri, 13 Jun 2014 01:48:18 +0000

import file-5.192014-06-09 9:04 Christos Zoulas * Misc buffer overruns and missing buffer size tests in cdf parsing (Francisco Alonso, Jan Kaluza)2014-06-02 14:50 Christos Zoulas * Enforce limit of 8K on regex searches that have no limits * Allow the l modifier for regex to mean line count. Default to byte count. If line count is specified, assume a max of 80 characters per line to limit the byte count. * Don't allow conversions to be used for dates, allowing the mask field to be used as an offset.2014-05-30 12:51 Christos Zoulas * Make the range operator limit the length of the regex search.2014-05-14 19:23 Christos Zoulas * PR/347: Windows fixes * PR/352: Hangul word processor recognition * PR/354: Encoding irregularities in text files2014-05-06 6:12 Christos Zoulas * Fix uninitialized title in CDF files (Jan Kaluza)2014-05-04 14:55 Christos Zoulas * PR/351: Fix compilation of empty files2014-04-30 17:39 Christos Zoulas * Fix integer formats: We don't specify 'l' or 'h' and 'hh' specifiers anymore, only 'll' for quads and nothing for the rest. This is so that magic writing is simpler.2014-04-01 15:25 Christos Zoulas * PR/341: Jan Kaluza, fix memory leak * PR/342: Jan Kaluza, fix out of bounds read2014-03-28 15:25 Christos Zoulas * Fix issue with long formats not matching fmtcheck List of files: /netbsd-src/external/bsd/file/dist/magic/magdir/python

52df37c7bda3678c3ba66668fe85774daeba1c3a - import file-5.14

Sat, 23 Mar 2013 15:49:08 +0000

import file-5.14changes are "name" + "use" keyword features, bug fixes List of files: /netbsd-src/external/bsd/file/dist/magic/magdir/python

2ae0d66f56c2c9e79baeeb2a918b3bc67265a8b8 - from ftp.astron.com

Thu, 03 Jan 2013 16:27:48 +0000

from ftp.astron.com List of files: /netbsd-src/external/bsd/file/dist/magic/magdir/python

f50962bc3d993057a1cd8131caeae5b9baf91e22 - from ftp.astron.com, CDF security fixes

Wed, 22 Feb 2012 17:48:04 +0000

from ftp.astron.com, CDF security fixes List of files: /netbsd-src/external/bsd/file/dist/magic/magdir/python

5ccaa8c050356ff0b3e7eb93c53dc31cacd69336 - from ftp.astron.com.

Thu, 12 May 2011 20:46:28 +0000

from ftp.astron.com.- many security related fixes- no MAXPATHLEN limits- fixed missing text specification on ascii magic- new ``pascal'' style string formats- whitespace comparison fix- more magic List of files: /netbsd-src/external/bsd/file/dist/magic/magdir/python

1b108b8bdefa551913f1e7021905fd360ebe561b - from ftp.astron.com

Fri, 08 May 2009 16:34:59 +0000

from ftp.astron.com List of files: /netbsd-src/external/bsd/file/dist/magic/magdir/python