1 |
ChangeLog for PCRE
|
2 |
------------------
|
3 |
|
4 |
|
5 |
Version 2.04 18-Feb-99
|
6 |
----------------------
|
7 |
|
8 |
1. For parenthesized subpatterns with repeats whose minimum was zero, the
|
9 |
computation of the store needed to hold the pattern was incorrect (too large).
|
10 |
If such patterns were nested a few deep, this could multiply and become a real
|
11 |
problem.
|
12 |
|
13 |
2. Added /M option to pcretest to show the memory requirement of a specific
|
14 |
pattern. Made -m a synonym of -s (which does this globally) for compatibility.
|
15 |
|
16 |
3. Subpatterns of the form (regex){n,m} (i.e. limited maximum) were being
|
17 |
compiled in such a way that the backtracking after subsequent failure was
|
18 |
pessimal. Something like (a){0,3} was compiled as (a)?(a)?(a)? instead of
|
19 |
((a)((a)(a)?)?)? with disastrous performance if the maximum was of any size.
|
20 |
|
21 |
|
22 |
Version 2.03 02-Feb-99
|
23 |
----------------------
|
24 |
|
25 |
1. Fixed typo and small mistake in man page.
|
26 |
|
27 |
2. Added 4th condition (GPL supersedes if conflict) and created separate
|
28 |
LICENCE file containing the conditions.
|
29 |
|
30 |
3. Updated pcretest so that patterns such as /abc\/def/ work like they do in
|
31 |
Perl, that is the internal \ allows the delimiter to be included in the
|
32 |
pattern. Locked out the use of \ as a delimiter. If \ immediately follows
|
33 |
the final delimiter, add \ to the end of the pattern (to test the error).
|
34 |
|
35 |
4. Added the convenience functions for extracting substrings after a successful
|
36 |
match. Updated pcretest to make it able to test these functions.
|
37 |
|
38 |
|
39 |
Version 2.02 14-Jan-99
|
40 |
----------------------
|
41 |
|
42 |
1. Initialized the working variables associated with each extraction so that
|
43 |
their saving and restoring doesn't refer to uninitialized store.
|
44 |
|
45 |
2. Put dummy code into study.c in order to trick the optimizer of the IBM C
|
46 |
compiler for OS/2 into generating correct code. Apparently IBM isn't going to
|
47 |
fix the problem.
|
48 |
|
49 |
3. Pcretest: the timing code wasn't using LOOPREPEAT for timing execution
|
50 |
calls, and wasn't printing the correct value for compiling calls. Increased the
|
51 |
default value of LOOPREPEAT, and the number of significant figures in the
|
52 |
times.
|
53 |
|
54 |
4. Changed "/bin/rm" in the Makefile to "-rm" so it works on Windows NT.
|
55 |
|
56 |
5. Renamed "deftables" as "dftables" to get it down to 8 characters, to avoid
|
57 |
a building problem on Windows NT with a FAT file system.
|
58 |
|
59 |
|
60 |
Version 2.01 21-Oct-98
|
61 |
----------------------
|
62 |
|
63 |
1. Changed the API for pcre_compile() to allow for the provision of a pointer
|
64 |
to character tables built by pcre_maketables() in the current locale. If NULL
|
65 |
is passed, the default tables are used.
|
66 |
|
67 |
|
68 |
Version 2.00 24-Sep-98
|
69 |
----------------------
|
70 |
|
71 |
1. Since the (>?) facility is in Perl 5.005, don't require PCRE_EXTRA to enable
|
72 |
it any more.
|
73 |
|
74 |
2. Allow quantification of (?>) groups, and make it work correctly.
|
75 |
|
76 |
3. The first character computation wasn't working for (?>) groups.
|
77 |
|
78 |
4. Correct the implementation of \Z (it is permitted to match on the \n at the
|
79 |
end of the subject) and add 5.005's \z, which really does match only at the
|
80 |
very end of the subject.
|
81 |
|
82 |
5. Remove the \X "cut" facility; Perl doesn't have it, and (?> is neater.
|
83 |
|
84 |
6. Remove the ability to specify CASELESS, MULTILINE, DOTALL, and
|
85 |
DOLLAR_END_ONLY at runtime, to make it possible to implement the Perl 5.005
|
86 |
localized options. All options to pcre_study() were also removed.
|
87 |
|
88 |
7. Add other new features from 5.005:
|
89 |
|
90 |
$(?<= positive lookbehind
|
91 |
$(?<! negative lookbehind
|
92 |
(?imsx-imsx) added the unsetting capability
|
93 |
such a setting is global if at outer level; local otherwise
|
94 |
(?imsx-imsx:) non-capturing groups with option setting
|
95 |
(?(cond)re|re) conditional pattern matching
|
96 |
|
97 |
A backreference to itself in a repeated group matches the previous
|
98 |
captured string.
|
99 |
|
100 |
8. General tidying up of studying (both automatic and via "study")
|
101 |
consequential on the addition of new assertions.
|
102 |
|
103 |
9. As in 5.005, unlimited repeated groups that could match an empty substring
|
104 |
are no longer faulted at compile time. Instead, the loop is forcibly broken at
|
105 |
runtime if any iteration does actually match an empty substring.
|
106 |
|
107 |
10. Include the RunTest script in the distribution.
|
108 |
|
109 |
11. Added tests from the Perl 5.005_02 distribution. This showed up a few
|
110 |
discrepancies, some of which were old and were also with respect to 5.004. They
|
111 |
have now been fixed.
|
112 |
|
113 |
|
114 |
Version 1.09 28-Apr-98
|
115 |
----------------------
|
116 |
|
117 |
1. A negated single character class followed by a quantifier with a minimum
|
118 |
value of one (e.g. [^x]{1,6} ) was not compiled correctly. This could lead to
|
119 |
program crashes, or just wrong answers. This did not apply to negated classes
|
120 |
containing more than one character, or to minima other than one.
|
121 |
|
122 |
|
123 |
Version 1.08 27-Mar-98
|
124 |
----------------------
|
125 |
|
126 |
1. Add PCRE_UNGREEDY to invert the greediness of quantifiers.
|
127 |
|
128 |
2. Add (?U) and (?X) to set PCRE_UNGREEDY and PCRE_EXTRA respectively. The
|
129 |
latter must appear before anything that relies on it in the pattern.
|
130 |
|
131 |
|
132 |
Version 1.07 16-Feb-98
|
133 |
----------------------
|
134 |
|
135 |
1. A pattern such as /((a)*)*/ was not being diagnosed as in error (unlimited
|
136 |
repeat of a potentially empty string).
|
137 |
|
138 |
|
139 |
Version 1.06 23-Jan-98
|
140 |
----------------------
|
141 |
|
142 |
1. Added Markus Oberhumer's little patches for C++.
|
143 |
|
144 |
2. Literal strings longer than 255 characters were broken.
|
145 |
|
146 |
|
147 |
Version 1.05 23-Dec-97
|
148 |
----------------------
|
149 |
|
150 |
1. Negated character classes containing more than one character were failing if
|
151 |
PCRE_CASELESS was set at run time.
|
152 |
|
153 |
|
154 |
Version 1.04 19-Dec-97
|
155 |
----------------------
|
156 |
|
157 |
1. Corrected the man page, where some "const" qualifiers had been omitted.
|
158 |
|
159 |
2. Made debugging output print "{0,xxx}" instead of just "{,xxx}" to agree with
|
160 |
input syntax.
|
161 |
|
162 |
3. Fixed memory leak which occurred when a regex with back references was
|
163 |
matched with an offsets vector that wasn't big enough. The temporary memory
|
164 |
that is used in this case wasn't being freed if the match failed.
|
165 |
|
166 |
4. Tidied pcretest to ensure it frees memory that it gets.
|
167 |
|
168 |
5. Temporary memory was being obtained in the case where the passed offsets
|
169 |
vector was exactly big enough.
|
170 |
|
171 |
6. Corrected definition of offsetof() from change 5 below.
|
172 |
|
173 |
7. I had screwed up change 6 below and broken the rules for the use of
|
174 |
setjmp(). Now fixed.
|
175 |
|
176 |
|
177 |
Version 1.03 18-Dec-97
|
178 |
----------------------
|
179 |
|
180 |
1. A erroneous regex with a missing opening parenthesis was correctly
|
181 |
diagnosed, but PCRE attempted to access brastack[-1], which could cause crashes
|
182 |
on some systems.
|
183 |
|
184 |
2. Replaced offsetof(real_pcre, code) by offsetof(real_pcre, code[0]) because
|
185 |
it was reported that one broken compiler failed on the former because "code" is
|
186 |
also an independent variable.
|
187 |
|
188 |
3. The erroneous regex a[]b caused an array overrun reference.
|
189 |
|
190 |
4. A regex ending with a one-character negative class (e.g. /[^k]$/) did not
|
191 |
fail on data ending with that character. (It was going on too far, and checking
|
192 |
the next character, typically a binary zero.) This was specific to the
|
193 |
optimized code for single-character negative classes.
|
194 |
|
195 |
5. Added a contributed patch from the TIN world which does the following:
|
196 |
|
197 |
+ Add an undef for memmove, in case the the system defines a macro for it.
|
198 |
|
199 |
+ Add a definition of offsetof(), in case there isn't one. (I don't know
|
200 |
the reason behind this - offsetof() is part of the ANSI standard - but
|
201 |
it does no harm).
|
202 |
|
203 |
+ Reduce the ifdef's in pcre.c using macro DPRINTF, thereby eliminating
|
204 |
most of the places where whitespace preceded '#'. I have given up and
|
205 |
allowed the remaining 2 cases to be at the margin.
|
206 |
|
207 |
+ Rename some variables in pcre to eliminate shadowing. This seems very
|
208 |
pedantic, but does no harm, of course.
|
209 |
|
210 |
6. Moved the call to setjmp() into its own function, to get rid of warnings
|
211 |
from gcc -Wall, and avoided calling it at all unless PCRE_EXTRA is used.
|
212 |
|
213 |
7. Constructs such as \d{8,} were compiling into the equivalent of
|
214 |
\d{8}\d{0,65527} instead of \d{8}\d* which didn't make much difference to the
|
215 |
outcome, but in this particular case used more store than had been allocated,
|
216 |
which caused the bug to be discovered because it threw up an internal error.
|
217 |
|
218 |
8. The debugging code in both pcre and pcretest for outputting the compiled
|
219 |
form of a regex was going wrong in the case of back references followed by
|
220 |
curly-bracketed repeats.
|
221 |
|
222 |
|
223 |
Version 1.02 12-Dec-97
|
224 |
----------------------
|
225 |
|
226 |
1. Typos in pcre.3 and comments in the source fixed.
|
227 |
|
228 |
2. Applied a contributed patch to get rid of places where it used to remove
|
229 |
'const' from variables, and fixed some signed/unsigned and uninitialized
|
230 |
variable warnings.
|
231 |
|
232 |
3. Added the "runtest" target to Makefile.
|
233 |
|
234 |
4. Set default compiler flag to -O2 rather than just -O.
|
235 |
|
236 |
|
237 |
Version 1.01 19-Nov-97
|
238 |
----------------------
|
239 |
|
240 |
1. PCRE was failing to diagnose unlimited repeat of empty string for patterns
|
241 |
like /([ab]*)*/, that is, for classes with more than one character in them.
|
242 |
|
243 |
2. Likewise, it wasn't diagnosing patterns with "once-only" subpatterns, such
|
244 |
as /((?>a*))*/ (a PCRE_EXTRA facility).
|
245 |
|
246 |
|
247 |
Version 1.00 18-Nov-97
|
248 |
----------------------
|
249 |
|
250 |
1. Added compile-time macros to support systems such as SunOS4 which don't have
|
251 |
memmove() or strerror() but have other things that can be used instead.
|
252 |
|
253 |
2. Arranged that "make clean" removes the executables.
|
254 |
|
255 |
|
256 |
Version 0.99 27-Oct-97
|
257 |
----------------------
|
258 |
|
259 |
1. Fixed bug in code for optimizing classes with only one character. It was
|
260 |
initializing a 32-byte map regardless, which could cause it to run off the end
|
261 |
of the memory it had got.
|
262 |
|
263 |
2. Added, conditional on PCRE_EXTRA, the proposed (?>REGEX) construction.
|
264 |
|
265 |
|
266 |
Version 0.98 22-Oct-97
|
267 |
----------------------
|
268 |
|
269 |
1. Fixed bug in code for handling temporary memory usage when there are more
|
270 |
back references than supplied space in the ovector. This could cause segfaults.
|
271 |
|
272 |
|
273 |
Version 0.97 21-Oct-97
|
274 |
----------------------
|
275 |
|
276 |
1. Added the \X "cut" facility, conditional on PCRE_EXTRA.
|
277 |
|
278 |
2. Optimized negated single characters not to use a bit map.
|
279 |
|
280 |
3. Brought error texts together as macro definitions; clarified some of them;
|
281 |
fixed one that was wrong - it said "range out of order" when it meant "invalid
|
282 |
escape sequence".
|
283 |
|
284 |
4. Changed some char * arguments to const char *.
|
285 |
|
286 |
5. Added PCRE_NOTBOL and PCRE_NOTEOL (from POSIX).
|
287 |
|
288 |
6. Added the POSIX-style API wrapper in pcreposix.a and testing facilities in
|
289 |
pcretest.
|
290 |
|
291 |
|
292 |
Version 0.96 16-Oct-97
|
293 |
----------------------
|
294 |
|
295 |
1. Added a simple "pgrep" utility to the distribution.
|
296 |
|
297 |
2. Fixed an incompatibility with Perl: "{" is now treated as a normal character
|
298 |
unless it appears in one of the precise forms "{ddd}", "{ddd,}", or "{ddd,ddd}"
|
299 |
where "ddd" means "one or more decimal digits".
|
300 |
|
301 |
3. Fixed serious bug. If a pattern had a back reference, but the call to
|
302 |
pcre_exec() didn't supply a large enough ovector to record the related
|
303 |
identifying subpattern, the match always failed. PCRE now remembers the number
|
304 |
of the largest back reference, and gets some temporary memory in which to save
|
305 |
the offsets during matching if necessary, in order to ensure that
|
306 |
backreferences always work.
|
307 |
|
308 |
4. Increased the compatibility with Perl in a number of ways:
|
309 |
|
310 |
(a) . no longer matches \n by default; an option PCRE_DOTALL is provided
|
311 |
to request this handling. The option can be set at compile or exec time.
|
312 |
|
313 |
(b) $ matches before a terminating newline by default; an option
|
314 |
PCRE_DOLLAR_ENDONLY is provided to override this (but not in multiline
|
315 |
mode). The option can be set at compile or exec time.
|
316 |
|
317 |
(c) The handling of \ followed by a digit other than 0 is now supposed to be
|
318 |
the same as Perl's. If the decimal number it represents is less than 10
|
319 |
or there aren't that many previous left capturing parentheses, an octal
|
320 |
escape is read. Inside a character class, it's always an octal escape,
|
321 |
even if it is a single digit.
|
322 |
|
323 |
(d) An escaped but undefined alphabetic character is taken as a literal,
|
324 |
unless PCRE_EXTRA is set. Currently this just reserves the remaining
|
325 |
escapes.
|
326 |
|
327 |
(e) {0} is now permitted. (The previous item is removed from the compiled
|
328 |
pattern).
|
329 |
|
330 |
5. Changed all the names of code files so that the basic parts are no longer
|
331 |
than 10 characters, and abolished the teeny "globals.c" file.
|
332 |
|
333 |
6. Changed the handling of character classes; they are now done with a 32-byte
|
334 |
bit map always.
|
335 |
|
336 |
7. Added the -d and /D options to pcretest to make it possible to look at the
|
337 |
internals of compilation without having to recompile pcre.
|
338 |
|
339 |
|
340 |
Version 0.95 23-Sep-97
|
341 |
----------------------
|
342 |
|
343 |
1. Fixed bug in pre-pass concerning escaped "normal" characters such as \x5c or
|
344 |
\x20 at the start of a run of normal characters. These were being treated as
|
345 |
real characters, instead of the source characters being re-checked.
|
346 |
|
347 |
|
348 |
Version 0.94 18-Sep-97
|
349 |
----------------------
|
350 |
|
351 |
1. The functions are now thread-safe, with the caveat that the global variables
|
352 |
containing pointers to malloc() and free() or alternative functions are the
|
353 |
same for all threads.
|
354 |
|
355 |
2. Get pcre_study() to generate a bitmap of initial characters for non-
|
356 |
anchored patterns when this is possible, and use it if passed to pcre_exec().
|
357 |
|
358 |
|
359 |
Version 0.93 15-Sep-97
|
360 |
----------------------
|
361 |
|
362 |
1. /(b)|(:+)/ was computing an incorrect first character.
|
363 |
|
364 |
2. Add pcre_study() to the API and the passing of pcre_extra to pcre_exec(),
|
365 |
but not actually doing anything yet.
|
366 |
|
367 |
3. Treat "-" characters in classes that cannot be part of ranges as literals,
|
368 |
as Perl does (e.g. [-az] or [az-]).
|
369 |
|
370 |
4. Set the anchored flag if a branch starts with .* or .*? because that tests
|
371 |
all possible positions.
|
372 |
|
373 |
5. Split up into different modules to avoid including unneeded functions in a
|
374 |
compiled binary. However, compile and exec are still in one module. The "study"
|
375 |
function is split off.
|
376 |
|
377 |
6. The character tables are now in a separate module whose source is generated
|
378 |
by an auxiliary program - but can then be edited by hand if required. There are
|
379 |
now no calls to isalnum(), isspace(), isdigit(), isxdigit(), tolower() or
|
380 |
toupper() in the code.
|
381 |
|
382 |
7. Turn the malloc/free funtions variables into pcre_malloc and pcre_free and
|
383 |
make them global. Abolish the function for setting them, as the caller can now
|
384 |
set them directly.
|
385 |
|
386 |
|
387 |
Version 0.92 11-Sep-97
|
388 |
----------------------
|
389 |
|
390 |
1. A repeat with a fixed maximum and a minimum of 1 for an ordinary character
|
391 |
(e.g. /a{1,3}/) was broken (I mis-optimized it).
|
392 |
|
393 |
2. Caseless matching was not working in character classes if the characters in
|
394 |
the pattern were in upper case.
|
395 |
|
396 |
3. Make ranges like [W-c] work in the same way as Perl for caseless matching.
|
397 |
|
398 |
4. Make PCRE_ANCHORED public and accept as a compile option.
|
399 |
|
400 |
5. Add an options word to pcre_exec() and accept PCRE_ANCHORED and
|
401 |
PCRE_CASELESS at run time. Add escapes \A and \I to pcretest to cause it to
|
402 |
pass them.
|
403 |
|
404 |
6. Give an error if bad option bits passed at compile or run time.
|
405 |
|
406 |
7. Add PCRE_MULTILINE at compile and exec time, and (?m) as well. Add \M to
|
407 |
pcretest to cause it to pass that flag.
|
408 |
|
409 |
8. Add pcre_info(), to get the number of identifying subpatterns, the stored
|
410 |
options, and the first character, if set.
|
411 |
|
412 |
9. Recognize C+ or C{n,m} where n >= 1 as providing a fixed starting character.
|
413 |
|
414 |
|
415 |
Version 0.91 10-Sep-97
|
416 |
----------------------
|
417 |
|
418 |
1. PCRE was failing to diagnose unlimited repeats of subpatterns that could
|
419 |
match the empty string as in /(a*)*/. It was looping and ultimately crashing.
|
420 |
|
421 |
2. PCRE was looping on encountering an indefinitely repeated back reference to
|
422 |
a subpattern that had matched an empty string, e.g. /(a|)\1*/. It now does what
|
423 |
Perl does - treats the match as successful.
|
424 |
|
425 |
****
|