| 1 |
ChangeLog for PCRE |
ChangeLog for PCRE |
| 2 |
------------------ |
------------------ |
| 3 |
|
|
| 4 |
|
Version 7.2 19-June-07 |
| 5 |
|
--------------------- |
| 6 |
|
|
| 7 |
|
1. If the fr_FR locale cannot be found for test 3, try the "french" locale, |
| 8 |
|
which is apparently normally available under Windows. |
| 9 |
|
|
| 10 |
|
2. Re-jig the pcregrep tests with different newline settings in an attempt |
| 11 |
|
to make them independent of the local environment's newline setting. |
| 12 |
|
|
| 13 |
|
3. Add code to configure.ac to remove -g from the CFLAGS default settings. |
| 14 |
|
|
| 15 |
|
4. Some of the "internals" tests were previously cut out when the link size |
| 16 |
|
was not 2, because the output contained actual offsets. The recent new |
| 17 |
|
"Z" feature of pcretest means that these can be cut out, making the tests |
| 18 |
|
usable with all link sizes. |
| 19 |
|
|
| 20 |
|
5. Implemented Stan Switzer's goto replacement for longjmp() when not using |
| 21 |
|
stack recursion. This gives a massive performance boost under BSD, but just |
| 22 |
|
a small improvement under Linux. However, it saves one field in the frame |
| 23 |
|
in all cases. |
| 24 |
|
|
| 25 |
|
6. Added more features from the forthcoming Perl 5.10: |
| 26 |
|
|
| 27 |
|
(a) (?-n) (where n is a string of digits) is a relative subroutine or |
| 28 |
|
recursion call. It refers to the nth most recently opened parentheses. |
| 29 |
|
|
| 30 |
|
(b) (?+n) is also a relative subroutine call; it refers to the nth next |
| 31 |
|
to be opened parentheses. |
| 32 |
|
|
| 33 |
|
(c) Conditions that refer to capturing parentheses can be specified |
| 34 |
|
relatively, for example, (?(-2)... or (?(+3)... |
| 35 |
|
|
| 36 |
|
(d) \K resets the start of the current match so that everything before |
| 37 |
|
is not part of it. |
| 38 |
|
|
| 39 |
|
(e) \k{name} is synonymous with \k<name> and \k'name' (.NET compatible). |
| 40 |
|
|
| 41 |
|
(f) \g{name} is another synonym - part of Perl 5.10's unification of |
| 42 |
|
reference syntax. |
| 43 |
|
|
| 44 |
|
(g) (?| introduces a group in which the numbering of parentheses in each |
| 45 |
|
alternative starts with the same number. |
| 46 |
|
|
| 47 |
|
(h) \h, \H, \v, and \V match horizontal and vertical whitespace. |
| 48 |
|
|
| 49 |
|
7. Added two new calls to pcre_fullinfo(): PCRE_INFO_OKPARTIAL and |
| 50 |
|
PCRE_INFO_JCHANGED. |
| 51 |
|
|
| 52 |
|
8. A pattern such as (.*(.)?)* caused pcre_exec() to fail by either not |
| 53 |
|
terminating or by crashing. Diagnosed by Viktor Griph; it was in the code |
| 54 |
|
for detecting groups that can match an empty string. |
| 55 |
|
|
| 56 |
|
9. A pattern with a very large number of alternatives (more than several |
| 57 |
|
hundred) was running out of internal workspace during the pre-compile |
| 58 |
|
phase, where pcre_compile() figures out how much memory will be needed. A |
| 59 |
|
bit of new cunning has reduced the workspace needed for groups with |
| 60 |
|
alternatives. The 1000-alternative test pattern now uses 12 bytes of |
| 61 |
|
workspace instead of running out of the 4096 that are available. |
| 62 |
|
|
| 63 |
|
10. Inserted some missing (unsigned int) casts to get rid of compiler warnings. |
| 64 |
|
|
| 65 |
|
11. Applied patch from Google to remove an optimization that didn't quite work. |
| 66 |
|
The report of the bug said: |
| 67 |
|
|
| 68 |
|
pcrecpp::RE("a*").FullMatch("aaa") matches, while |
| 69 |
|
pcrecpp::RE("a*?").FullMatch("aaa") does not, and |
| 70 |
|
pcrecpp::RE("a*?\\z").FullMatch("aaa") does again. |
| 71 |
|
|
| 72 |
|
12. If \p or \P was used in non-UTF-8 mode on a character greater than 127 |
| 73 |
|
it matched the wrong number of bytes. |
| 74 |
|
|
| 75 |
|
|
| 76 |
|
Version 7.1 24-Apr-07 |
| 77 |
|
--------------------- |
| 78 |
|
|
| 79 |
|
1. Applied Bob Rossi and Daniel G's patches to convert the build system to one |
| 80 |
|
that is more "standard", making use of automake and other Autotools. There |
| 81 |
|
is some re-arrangement of the files and adjustment of comments consequent |
| 82 |
|
on this. |
| 83 |
|
|
| 84 |
|
2. Part of the patch fixed a problem with the pcregrep tests. The test of -r |
| 85 |
|
for recursive directory scanning broke on some systems because the files |
| 86 |
|
are not scanned in any specific order and on different systems the order |
| 87 |
|
was different. A call to "sort" has been inserted into RunGrepTest for the |
| 88 |
|
approprate test as a short-term fix. In the longer term there may be an |
| 89 |
|
alternative. |
| 90 |
|
|
| 91 |
|
3. I had an email from Eric Raymond about problems translating some of PCRE's |
| 92 |
|
man pages to HTML (despite the fact that I distribute HTML pages, some |
| 93 |
|
people do their own conversions for various reasons). The problems |
| 94 |
|
concerned the use of low-level troff macros .br and .in. I have therefore |
| 95 |
|
removed all such uses from the man pages (some were redundant, some could |
| 96 |
|
be replaced by .nf/.fi pairs). The 132html script that I use to generate |
| 97 |
|
HTML has been updated to handle .nf/.fi and to complain if it encounters |
| 98 |
|
.br or .in. |
| 99 |
|
|
| 100 |
|
4. Updated comments in configure.ac that get placed in config.h.in and also |
| 101 |
|
arranged for config.h to be included in the distribution, with the name |
| 102 |
|
config.h.generic, for the benefit of those who have to compile without |
| 103 |
|
Autotools (compare pcre.h, which is now distributed as pcre.h.generic). |
| 104 |
|
|
| 105 |
|
5. Updated the support (such as it is) for Virtual Pascal, thanks to Stefan |
| 106 |
|
Weber: (1) pcre_internal.h was missing some function renames; (2) updated |
| 107 |
|
makevp.bat for the current PCRE, using the additional files |
| 108 |
|
makevp_c.txt, makevp_l.txt, and pcregexp.pas. |
| 109 |
|
|
| 110 |
|
6. A Windows user reported a minor discrepancy with test 2, which turned out |
| 111 |
|
to be caused by a trailing space on an input line that had got lost in his |
| 112 |
|
copy. The trailing space was an accident, so I've just removed it. |
| 113 |
|
|
| 114 |
|
7. Add -Wl,-R... flags in pcre-config.in for *BSD* systems, as I'm told |
| 115 |
|
that is needed. |
| 116 |
|
|
| 117 |
|
8. Mark ucp_table (in ucptable.h) and ucp_gentype (in pcre_ucp_searchfuncs.c) |
| 118 |
|
as "const" (a) because they are and (b) because it helps the PHP |
| 119 |
|
maintainers who have recently made a script to detect big data structures |
| 120 |
|
in the php code that should be moved to the .rodata section. I remembered |
| 121 |
|
to update Builducptable as well, so it won't revert if ucptable.h is ever |
| 122 |
|
re-created. |
| 123 |
|
|
| 124 |
|
9. Added some extra #ifdef SUPPORT_UTF8 conditionals into pcretest.c, |
| 125 |
|
pcre_printint.src, pcre_compile.c, pcre_study.c, and pcre_tables.c, in |
| 126 |
|
order to be able to cut out the UTF-8 tables in the latter when UTF-8 |
| 127 |
|
support is not required. This saves 1.5-2K of code, which is important in |
| 128 |
|
some applications. |
| 129 |
|
|
| 130 |
|
Later: more #ifdefs are needed in pcre_ord2utf8.c and pcre_valid_utf8.c |
| 131 |
|
so as not to refer to the tables, even though these functions will never be |
| 132 |
|
called when UTF-8 support is disabled. Otherwise there are problems with a |
| 133 |
|
shared library. |
| 134 |
|
|
| 135 |
|
10. Fixed two bugs in the emulated memmove() function in pcre_internal.h: |
| 136 |
|
|
| 137 |
|
(a) It was defining its arguments as char * instead of void *. |
| 138 |
|
|
| 139 |
|
(b) It was assuming that all moves were upwards in memory; this was true |
| 140 |
|
a long time ago when I wrote it, but is no longer the case. |
| 141 |
|
|
| 142 |
|
The emulated memove() is provided for those environments that have neither |
| 143 |
|
memmove() nor bcopy(). I didn't think anyone used it these days, but that |
| 144 |
|
is clearly not the case, as these two bugs were recently reported. |
| 145 |
|
|
| 146 |
|
11. The script PrepareRelease is now distributed: it calls 132html, CleanTxt, |
| 147 |
|
and Detrail to create the HTML documentation, the .txt form of the man |
| 148 |
|
pages, and it removes trailing spaces from listed files. It also creates |
| 149 |
|
pcre.h.generic and config.h.generic from pcre.h and config.h. In the latter |
| 150 |
|
case, it wraps all the #defines with #ifndefs. This script should be run |
| 151 |
|
before "make dist". |
| 152 |
|
|
| 153 |
|
12. Fixed two fairly obscure bugs concerned with quantified caseless matching |
| 154 |
|
with Unicode property support. |
| 155 |
|
|
| 156 |
|
(a) For a maximizing quantifier, if the two different cases of the |
| 157 |
|
character were of different lengths in their UTF-8 codings (there are |
| 158 |
|
some cases like this - I found 11), and the matching function had to |
| 159 |
|
back up over a mixture of the two cases, it incorrectly assumed they |
| 160 |
|
were both the same length. |
| 161 |
|
|
| 162 |
|
(b) When PCRE was configured to use the heap rather than the stack for |
| 163 |
|
recursion during matching, it was not correctly preserving the data for |
| 164 |
|
the other case of a UTF-8 character when checking ahead for a match |
| 165 |
|
while processing a minimizing repeat. If the check also involved |
| 166 |
|
matching a wide character, but failed, corruption could cause an |
| 167 |
|
erroneous result when trying to check for a repeat of the original |
| 168 |
|
character. |
| 169 |
|
|
| 170 |
|
13. Some tidying changes to the testing mechanism: |
| 171 |
|
|
| 172 |
|
(a) The RunTest script now detects the internal link size and whether there |
| 173 |
|
is UTF-8 and UCP support by running ./pcretest -C instead of relying on |
| 174 |
|
values substituted by "configure". (The RunGrepTest script already did |
| 175 |
|
this for UTF-8.) The configure.ac script no longer substitutes the |
| 176 |
|
relevant variables. |
| 177 |
|
|
| 178 |
|
(b) The debugging options /B and /D in pcretest show the compiled bytecode |
| 179 |
|
with length and offset values. This means that the output is different |
| 180 |
|
for different internal link sizes. Test 2 is skipped for link sizes |
| 181 |
|
other than 2 because of this, bypassing the problem. Unfortunately, |
| 182 |
|
there was also a test in test 3 (the locale tests) that used /B and |
| 183 |
|
failed for link sizes other than 2. Rather than cut the whole test out, |
| 184 |
|
I have added a new /Z option to pcretest that replaces the length and |
| 185 |
|
offset values with spaces. This is now used to make test 3 independent |
| 186 |
|
of link size. (Test 2 will be tidied up later.) |
| 187 |
|
|
| 188 |
|
14. If erroroffset was passed as NULL to pcre_compile, it provoked a |
| 189 |
|
segmentation fault instead of returning the appropriate error message. |
| 190 |
|
|
| 191 |
|
15. In multiline mode when the newline sequence was set to "any", the pattern |
| 192 |
|
^$ would give a match between the \r and \n of a subject such as "A\r\nB". |
| 193 |
|
This doesn't seem right; it now treats the CRLF combination as the line |
| 194 |
|
ending, and so does not match in that case. It's only a pattern such as ^$ |
| 195 |
|
that would hit this one: something like ^ABC$ would have failed after \r |
| 196 |
|
and then tried again after \r\n. |
| 197 |
|
|
| 198 |
|
16. Changed the comparison command for RunGrepTest from "diff -u" to "diff -ub" |
| 199 |
|
in an attempt to make files that differ only in their line terminators |
| 200 |
|
compare equal. This works on Linux. |
| 201 |
|
|
| 202 |
|
17. Under certain error circumstances pcregrep might try to free random memory |
| 203 |
|
as it exited. This is now fixed, thanks to valgrind. |
| 204 |
|
|
| 205 |
|
19. In pcretest, if the pattern /(?m)^$/g<any> was matched against the string |
| 206 |
|
"abc\r\n\r\n", it found an unwanted second match after the second \r. This |
| 207 |
|
was because its rules for how to advance for /g after matching an empty |
| 208 |
|
string at the end of a line did not allow for this case. They now check for |
| 209 |
|
it specially. |
| 210 |
|
|
| 211 |
|
20. pcretest is supposed to handle patterns and data of any length, by |
| 212 |
|
extending its buffers when necessary. It was getting this wrong when the |
| 213 |
|
buffer for a data line had to be extended. |
| 214 |
|
|
| 215 |
|
21. Added PCRE_NEWLINE_ANYCRLF which is like ANY, but matches only CR, LF, or |
| 216 |
|
CRLF as a newline sequence. |
| 217 |
|
|
| 218 |
|
22. Code for handling Unicode properties in pcre_dfa_exec() wasn't being cut |
| 219 |
|
out by #ifdef SUPPORT_UCP. This did no harm, as it could never be used, but |
| 220 |
|
I have nevertheless tidied it up. |
| 221 |
|
|
| 222 |
|
23. Added some casts to kill warnings from HP-UX ia64 compiler. |
| 223 |
|
|
| 224 |
|
24. Added a man page for pcre-config. |
| 225 |
|
|
| 226 |
|
|
| 227 |
Version 7.0 19-Dec-06 |
Version 7.0 19-Dec-06 |
| 228 |
--------------------- |
--------------------- |
| 229 |
|
|
Parent Directory
| 
Revision Log
| 
Patch