1 |
ChangeLog for PCRE |
ChangeLog for PCRE |
2 |
------------------ |
------------------ |
3 |
|
|
4 |
Version 7.1 05-Mar-07 |
Version 7.3 05-Jul-07 |
5 |
--------------------- |
--------------------- |
6 |
|
|
7 |
1. Applied Bob Rossi and Daniel G's patches to convert the build system to one |
1. In the rejigging of the build system that eventually resulted in 7.1, the |
8 |
that is more "standard", making use of automake and other autotools. |
line "#include <pcre.h>" was included in pcre_internal.h. The use of angle |
9 |
|
brackets there is not right, since it causes compilers to look for an |
10 |
|
installed pcre.h, not the version that is in the source that is being |
11 |
|
compiled (which of course may be different). I have changed it back to: |
12 |
|
|
13 |
|
#include "pcre.h" |
14 |
|
|
15 |
|
I have a vague recollection that the change was concerned with compiling in |
16 |
|
different directories, but in the new build system, that is taken care of |
17 |
|
by the VPATH setting the Makefile. |
18 |
|
|
19 |
|
2. The pattern .*$ when run in not-DOTALL UTF-8 mode with newline=any failed |
20 |
|
when the subject happened to end in the byte 0x85 (e.g. if the last |
21 |
|
character was \x{1ec5}). *Character* 0x85 is one of the "any" newline |
22 |
|
characters but of course it shouldn't be taken as a newline when it is part |
23 |
|
of another character. The bug was that, for an unlimited repeat of . in |
24 |
|
not-DOTALL UTF-8 mode, PCRE was advancing by bytes rather than by |
25 |
|
characters when looking for a newline. |
26 |
|
|
27 |
|
3. A small performance improvement in the DOTALL UTF-8 mode .* case. |
28 |
|
|
29 |
|
4. Debugging: adjusted the names of opcodes for different kinds of parentheses |
30 |
|
in debug output. |
31 |
|
|
32 |
|
5. Arrange to use "%I64d" instead of "%lld" for long printing in the pcrecpp |
33 |
|
unittest when running under MinGW. |
34 |
|
|
35 |
|
|
36 |
|
|
37 |
|
Version 7.2 19-Jun-07 |
38 |
|
--------------------- |
39 |
|
|
40 |
|
1. If the fr_FR locale cannot be found for test 3, try the "french" locale, |
41 |
|
which is apparently normally available under Windows. |
42 |
|
|
43 |
|
2. Re-jig the pcregrep tests with different newline settings in an attempt |
44 |
|
to make them independent of the local environment's newline setting. |
45 |
|
|
46 |
|
3. Add code to configure.ac to remove -g from the CFLAGS default settings. |
47 |
|
|
48 |
|
4. Some of the "internals" tests were previously cut out when the link size |
49 |
|
was not 2, because the output contained actual offsets. The recent new |
50 |
|
"Z" feature of pcretest means that these can be cut out, making the tests |
51 |
|
usable with all link sizes. |
52 |
|
|
53 |
|
5. Implemented Stan Switzer's goto replacement for longjmp() when not using |
54 |
|
stack recursion. This gives a massive performance boost under BSD, but just |
55 |
|
a small improvement under Linux. However, it saves one field in the frame |
56 |
|
in all cases. |
57 |
|
|
58 |
|
6. Added more features from the forthcoming Perl 5.10: |
59 |
|
|
60 |
|
(a) (?-n) (where n is a string of digits) is a relative subroutine or |
61 |
|
recursion call. It refers to the nth most recently opened parentheses. |
62 |
|
|
63 |
|
(b) (?+n) is also a relative subroutine call; it refers to the nth next |
64 |
|
to be opened parentheses. |
65 |
|
|
66 |
|
(c) Conditions that refer to capturing parentheses can be specified |
67 |
|
relatively, for example, (?(-2)... or (?(+3)... |
68 |
|
|
69 |
|
(d) \K resets the start of the current match so that everything before |
70 |
|
is not part of it. |
71 |
|
|
72 |
|
(e) \k{name} is synonymous with \k<name> and \k'name' (.NET compatible). |
73 |
|
|
74 |
|
(f) \g{name} is another synonym - part of Perl 5.10's unification of |
75 |
|
reference syntax. |
76 |
|
|
77 |
|
(g) (?| introduces a group in which the numbering of parentheses in each |
78 |
|
alternative starts with the same number. |
79 |
|
|
80 |
|
(h) \h, \H, \v, and \V match horizontal and vertical whitespace. |
81 |
|
|
82 |
|
7. Added two new calls to pcre_fullinfo(): PCRE_INFO_OKPARTIAL and |
83 |
|
PCRE_INFO_JCHANGED. |
84 |
|
|
85 |
|
8. A pattern such as (.*(.)?)* caused pcre_exec() to fail by either not |
86 |
|
terminating or by crashing. Diagnosed by Viktor Griph; it was in the code |
87 |
|
for detecting groups that can match an empty string. |
88 |
|
|
89 |
|
9. A pattern with a very large number of alternatives (more than several |
90 |
|
hundred) was running out of internal workspace during the pre-compile |
91 |
|
phase, where pcre_compile() figures out how much memory will be needed. A |
92 |
|
bit of new cunning has reduced the workspace needed for groups with |
93 |
|
alternatives. The 1000-alternative test pattern now uses 12 bytes of |
94 |
|
workspace instead of running out of the 4096 that are available. |
95 |
|
|
96 |
|
10. Inserted some missing (unsigned int) casts to get rid of compiler warnings. |
97 |
|
|
98 |
|
11. Applied patch from Google to remove an optimization that didn't quite work. |
99 |
|
The report of the bug said: |
100 |
|
|
101 |
|
pcrecpp::RE("a*").FullMatch("aaa") matches, while |
102 |
|
pcrecpp::RE("a*?").FullMatch("aaa") does not, and |
103 |
|
pcrecpp::RE("a*?\\z").FullMatch("aaa") does again. |
104 |
|
|
105 |
|
12. If \p or \P was used in non-UTF-8 mode on a character greater than 127 |
106 |
|
it matched the wrong number of bytes. |
107 |
|
|
108 |
|
|
109 |
|
Version 7.1 24-Apr-07 |
110 |
|
--------------------- |
111 |
|
|
112 |
|
1. Applied Bob Rossi and Daniel G's patches to convert the build system to one |
113 |
|
that is more "standard", making use of automake and other Autotools. There |
114 |
|
is some re-arrangement of the files and adjustment of comments consequent |
115 |
|
on this. |
116 |
|
|
117 |
|
2. Part of the patch fixed a problem with the pcregrep tests. The test of -r |
118 |
|
for recursive directory scanning broke on some systems because the files |
119 |
|
are not scanned in any specific order and on different systems the order |
120 |
|
was different. A call to "sort" has been inserted into RunGrepTest for the |
121 |
|
approprate test as a short-term fix. In the longer term there may be an |
122 |
|
alternative. |
123 |
|
|
124 |
|
3. I had an email from Eric Raymond about problems translating some of PCRE's |
125 |
|
man pages to HTML (despite the fact that I distribute HTML pages, some |
126 |
|
people do their own conversions for various reasons). The problems |
127 |
|
concerned the use of low-level troff macros .br and .in. I have therefore |
128 |
|
removed all such uses from the man pages (some were redundant, some could |
129 |
|
be replaced by .nf/.fi pairs). The 132html script that I use to generate |
130 |
|
HTML has been updated to handle .nf/.fi and to complain if it encounters |
131 |
|
.br or .in. |
132 |
|
|
133 |
|
4. Updated comments in configure.ac that get placed in config.h.in and also |
134 |
|
arranged for config.h to be included in the distribution, with the name |
135 |
|
config.h.generic, for the benefit of those who have to compile without |
136 |
|
Autotools (compare pcre.h, which is now distributed as pcre.h.generic). |
137 |
|
|
138 |
|
5. Updated the support (such as it is) for Virtual Pascal, thanks to Stefan |
139 |
|
Weber: (1) pcre_internal.h was missing some function renames; (2) updated |
140 |
|
makevp.bat for the current PCRE, using the additional files |
141 |
|
makevp_c.txt, makevp_l.txt, and pcregexp.pas. |
142 |
|
|
143 |
|
6. A Windows user reported a minor discrepancy with test 2, which turned out |
144 |
|
to be caused by a trailing space on an input line that had got lost in his |
145 |
|
copy. The trailing space was an accident, so I've just removed it. |
146 |
|
|
147 |
|
7. Add -Wl,-R... flags in pcre-config.in for *BSD* systems, as I'm told |
148 |
|
that is needed. |
149 |
|
|
150 |
|
8. Mark ucp_table (in ucptable.h) and ucp_gentype (in pcre_ucp_searchfuncs.c) |
151 |
|
as "const" (a) because they are and (b) because it helps the PHP |
152 |
|
maintainers who have recently made a script to detect big data structures |
153 |
|
in the php code that should be moved to the .rodata section. I remembered |
154 |
|
to update Builducptable as well, so it won't revert if ucptable.h is ever |
155 |
|
re-created. |
156 |
|
|
157 |
|
9. Added some extra #ifdef SUPPORT_UTF8 conditionals into pcretest.c, |
158 |
|
pcre_printint.src, pcre_compile.c, pcre_study.c, and pcre_tables.c, in |
159 |
|
order to be able to cut out the UTF-8 tables in the latter when UTF-8 |
160 |
|
support is not required. This saves 1.5-2K of code, which is important in |
161 |
|
some applications. |
162 |
|
|
163 |
|
Later: more #ifdefs are needed in pcre_ord2utf8.c and pcre_valid_utf8.c |
164 |
|
so as not to refer to the tables, even though these functions will never be |
165 |
|
called when UTF-8 support is disabled. Otherwise there are problems with a |
166 |
|
shared library. |
167 |
|
|
168 |
|
10. Fixed two bugs in the emulated memmove() function in pcre_internal.h: |
169 |
|
|
170 |
|
(a) It was defining its arguments as char * instead of void *. |
171 |
|
|
172 |
|
(b) It was assuming that all moves were upwards in memory; this was true |
173 |
|
a long time ago when I wrote it, but is no longer the case. |
174 |
|
|
175 |
|
The emulated memove() is provided for those environments that have neither |
176 |
|
memmove() nor bcopy(). I didn't think anyone used it these days, but that |
177 |
|
is clearly not the case, as these two bugs were recently reported. |
178 |
|
|
179 |
|
11. The script PrepareRelease is now distributed: it calls 132html, CleanTxt, |
180 |
|
and Detrail to create the HTML documentation, the .txt form of the man |
181 |
|
pages, and it removes trailing spaces from listed files. It also creates |
182 |
|
pcre.h.generic and config.h.generic from pcre.h and config.h. In the latter |
183 |
|
case, it wraps all the #defines with #ifndefs. This script should be run |
184 |
|
before "make dist". |
185 |
|
|
186 |
|
12. Fixed two fairly obscure bugs concerned with quantified caseless matching |
187 |
|
with Unicode property support. |
188 |
|
|
189 |
|
(a) For a maximizing quantifier, if the two different cases of the |
190 |
|
character were of different lengths in their UTF-8 codings (there are |
191 |
|
some cases like this - I found 11), and the matching function had to |
192 |
|
back up over a mixture of the two cases, it incorrectly assumed they |
193 |
|
were both the same length. |
194 |
|
|
195 |
|
(b) When PCRE was configured to use the heap rather than the stack for |
196 |
|
recursion during matching, it was not correctly preserving the data for |
197 |
|
the other case of a UTF-8 character when checking ahead for a match |
198 |
|
while processing a minimizing repeat. If the check also involved |
199 |
|
matching a wide character, but failed, corruption could cause an |
200 |
|
erroneous result when trying to check for a repeat of the original |
201 |
|
character. |
202 |
|
|
203 |
|
13. Some tidying changes to the testing mechanism: |
204 |
|
|
205 |
|
(a) The RunTest script now detects the internal link size and whether there |
206 |
|
is UTF-8 and UCP support by running ./pcretest -C instead of relying on |
207 |
|
values substituted by "configure". (The RunGrepTest script already did |
208 |
|
this for UTF-8.) The configure.ac script no longer substitutes the |
209 |
|
relevant variables. |
210 |
|
|
211 |
|
(b) The debugging options /B and /D in pcretest show the compiled bytecode |
212 |
|
with length and offset values. This means that the output is different |
213 |
|
for different internal link sizes. Test 2 is skipped for link sizes |
214 |
|
other than 2 because of this, bypassing the problem. Unfortunately, |
215 |
|
there was also a test in test 3 (the locale tests) that used /B and |
216 |
|
failed for link sizes other than 2. Rather than cut the whole test out, |
217 |
|
I have added a new /Z option to pcretest that replaces the length and |
218 |
|
offset values with spaces. This is now used to make test 3 independent |
219 |
|
of link size. (Test 2 will be tidied up later.) |
220 |
|
|
221 |
|
14. If erroroffset was passed as NULL to pcre_compile, it provoked a |
222 |
|
segmentation fault instead of returning the appropriate error message. |
223 |
|
|
224 |
|
15. In multiline mode when the newline sequence was set to "any", the pattern |
225 |
|
^$ would give a match between the \r and \n of a subject such as "A\r\nB". |
226 |
|
This doesn't seem right; it now treats the CRLF combination as the line |
227 |
|
ending, and so does not match in that case. It's only a pattern such as ^$ |
228 |
|
that would hit this one: something like ^ABC$ would have failed after \r |
229 |
|
and then tried again after \r\n. |
230 |
|
|
231 |
|
16. Changed the comparison command for RunGrepTest from "diff -u" to "diff -ub" |
232 |
|
in an attempt to make files that differ only in their line terminators |
233 |
|
compare equal. This works on Linux. |
234 |
|
|
235 |
|
17. Under certain error circumstances pcregrep might try to free random memory |
236 |
|
as it exited. This is now fixed, thanks to valgrind. |
237 |
|
|
238 |
|
19. In pcretest, if the pattern /(?m)^$/g<any> was matched against the string |
239 |
|
"abc\r\n\r\n", it found an unwanted second match after the second \r. This |
240 |
|
was because its rules for how to advance for /g after matching an empty |
241 |
|
string at the end of a line did not allow for this case. They now check for |
242 |
|
it specially. |
243 |
|
|
244 |
|
20. pcretest is supposed to handle patterns and data of any length, by |
245 |
|
extending its buffers when necessary. It was getting this wrong when the |
246 |
|
buffer for a data line had to be extended. |
247 |
|
|
248 |
|
21. Added PCRE_NEWLINE_ANYCRLF which is like ANY, but matches only CR, LF, or |
249 |
|
CRLF as a newline sequence. |
250 |
|
|
251 |
|
22. Code for handling Unicode properties in pcre_dfa_exec() wasn't being cut |
252 |
|
out by #ifdef SUPPORT_UCP. This did no harm, as it could never be used, but |
253 |
|
I have nevertheless tidied it up. |
254 |
|
|
255 |
|
23. Added some casts to kill warnings from HP-UX ia64 compiler. |
256 |
|
|
257 |
|
24. Added a man page for pcre-config. |
258 |
|
|
259 |
|
|
260 |
Version 7.0 19-Dec-06 |
Version 7.0 19-Dec-06 |