1 |
ChangeLog for PCRE
|
2 |
------------------
|
3 |
|
4 |
|
5 |
Version 2.01 21-Oct-98
|
6 |
----------------------
|
7 |
|
8 |
1. Changed the API for pcre_compile() to allow for the provision of a pointer
|
9 |
to character tables built by pcre_maketables() in the current locale. If NULL
|
10 |
is passed, the default tables are used.
|
11 |
|
12 |
|
13 |
Version 2.00 24-Sep-98
|
14 |
----------------------
|
15 |
|
16 |
1. Since the (>?) facility is in Perl 5.005, don't require PCRE_EXTRA to enable
|
17 |
it any more.
|
18 |
|
19 |
2. Allow quantification of (?>) groups, and make it work correctly.
|
20 |
|
21 |
3. The first character computation wasn't working for (?>) groups.
|
22 |
|
23 |
4. Correct the implementation of \Z (it is permitted to match on the \n at the
|
24 |
end of the subject) and add 5.005's \z, which really does match only at the
|
25 |
very end of the subject.
|
26 |
|
27 |
5. Remove the \X "cut" facility; Perl doesn't have it, and (?> is neater.
|
28 |
|
29 |
6. Remove the ability to specify CASELESS, MULTILINE, DOTALL, and
|
30 |
DOLLAR_END_ONLY at runtime, to make it possible to implement the Perl 5.005
|
31 |
localized options. All options to pcre_study() were also removed.
|
32 |
|
33 |
7. Add other new features from 5.005:
|
34 |
|
35 |
$(?<= positive lookbehind
|
36 |
$(?<! negative lookbehind
|
37 |
(?imsx-imsx) added the unsetting capability
|
38 |
such a setting is global if at outer level; local otherwise
|
39 |
(?imsx-imsx:) non-capturing groups with option setting
|
40 |
(?(cond)re|re) conditional pattern matching
|
41 |
|
42 |
A backreference to itself in a repeated group matches the previous
|
43 |
captured string.
|
44 |
|
45 |
8. General tidying up of studying (both automatic and via "study")
|
46 |
consequential on the addition of new assertions.
|
47 |
|
48 |
9. As in 5.005, unlimited repeated groups that could match an empty substring
|
49 |
are no longer faulted at compile time. Instead, the loop is forcibly broken at
|
50 |
runtime if any iteration does actually match an empty substring.
|
51 |
|
52 |
10. Include the RunTest script in the distribution.
|
53 |
|
54 |
11. Added tests from the Perl 5.005_02 distribution. This showed up a few
|
55 |
discrepancies, some of which were old and were also with respect to 5.004. They
|
56 |
have now been fixed.
|
57 |
|
58 |
|
59 |
Version 1.09 28-Apr-98
|
60 |
----------------------
|
61 |
|
62 |
1. A negated single character class followed by a quantifier with a minimum
|
63 |
value of one (e.g. [^x]{1,6} ) was not compiled correctly. This could lead to
|
64 |
program crashes, or just wrong answers. This did not apply to negated classes
|
65 |
containing more than one character, or to minima other than one.
|
66 |
|
67 |
|
68 |
Version 1.08 27-Mar-98
|
69 |
----------------------
|
70 |
|
71 |
1. Add PCRE_UNGREEDY to invert the greediness of quantifiers.
|
72 |
|
73 |
2. Add (?U) and (?X) to set PCRE_UNGREEDY and PCRE_EXTRA respectively. The
|
74 |
latter must appear before anything that relies on it in the pattern.
|
75 |
|
76 |
|
77 |
Version 1.07 16-Feb-98
|
78 |
----------------------
|
79 |
|
80 |
1. A pattern such as /((a)*)*/ was not being diagnosed as in error (unlimited
|
81 |
repeat of a potentially empty string).
|
82 |
|
83 |
|
84 |
Version 1.06 23-Jan-98
|
85 |
----------------------
|
86 |
|
87 |
1. Added Markus Oberhumer's little patches for C++.
|
88 |
|
89 |
2. Literal strings longer than 255 characters were broken.
|
90 |
|
91 |
|
92 |
Version 1.05 23-Dec-97
|
93 |
----------------------
|
94 |
|
95 |
1. Negated character classes containing more than one character were failing if
|
96 |
PCRE_CASELESS was set at run time.
|
97 |
|
98 |
|
99 |
Version 1.04 19-Dec-97
|
100 |
----------------------
|
101 |
|
102 |
1. Corrected the man page, where some "const" qualifiers had been omitted.
|
103 |
|
104 |
2. Made debugging output print "{0,xxx}" instead of just "{,xxx}" to agree with
|
105 |
input syntax.
|
106 |
|
107 |
3. Fixed memory leak which occurred when a regex with back references was
|
108 |
matched with an offsets vector that wasn't big enough. The temporary memory
|
109 |
that is used in this case wasn't being freed if the match failed.
|
110 |
|
111 |
4. Tidied pcretest to ensure it frees memory that it gets.
|
112 |
|
113 |
5. Temporary memory was being obtained in the case where the passed offsets
|
114 |
vector was exactly big enough.
|
115 |
|
116 |
6. Corrected definition of offsetof() from change 5 below.
|
117 |
|
118 |
7. I had screwed up change 6 below and broken the rules for the use of
|
119 |
setjmp(). Now fixed.
|
120 |
|
121 |
|
122 |
Version 1.03 18-Dec-97
|
123 |
----------------------
|
124 |
|
125 |
1. A erroneous regex with a missing opening parenthesis was correctly
|
126 |
diagnosed, but PCRE attempted to access brastack[-1], which could cause crashes
|
127 |
on some systems.
|
128 |
|
129 |
2. Replaced offsetof(real_pcre, code) by offsetof(real_pcre, code[0]) because
|
130 |
it was reported that one broken compiler failed on the former because "code" is
|
131 |
also an independent variable.
|
132 |
|
133 |
3. The erroneous regex a[]b caused an array overrun reference.
|
134 |
|
135 |
4. A regex ending with a one-character negative class (e.g. /[^k]$/) did not
|
136 |
fail on data ending with that character. (It was going on too far, and checking
|
137 |
the next character, typically a binary zero.) This was specific to the
|
138 |
optimized code for single-character negative classes.
|
139 |
|
140 |
5. Added a contributed patch from the TIN world which does the following:
|
141 |
|
142 |
+ Add an undef for memmove, in case the the system defines a macro for it.
|
143 |
|
144 |
+ Add a definition of offsetof(), in case there isn't one. (I don't know
|
145 |
the reason behind this - offsetof() is part of the ANSI standard - but
|
146 |
it does no harm).
|
147 |
|
148 |
+ Reduce the ifdef's in pcre.c using macro DPRINTF, thereby eliminating
|
149 |
most of the places where whitespace preceded '#'. I have given up and
|
150 |
allowed the remaining 2 cases to be at the margin.
|
151 |
|
152 |
+ Rename some variables in pcre to eliminate shadowing. This seems very
|
153 |
pedantic, but does no harm, of course.
|
154 |
|
155 |
6. Moved the call to setjmp() into its own function, to get rid of warnings
|
156 |
from gcc -Wall, and avoided calling it at all unless PCRE_EXTRA is used.
|
157 |
|
158 |
7. Constructs such as \d{8,} were compiling into the equivalent of
|
159 |
\d{8}\d{0,65527} instead of \d{8}\d* which didn't make much difference to the
|
160 |
outcome, but in this particular case used more store than had been allocated,
|
161 |
which caused the bug to be discovered because it threw up an internal error.
|
162 |
|
163 |
8. The debugging code in both pcre and pcretest for outputting the compiled
|
164 |
form of a regex was going wrong in the case of back references followed by
|
165 |
curly-bracketed repeats.
|
166 |
|
167 |
|
168 |
Version 1.02 12-Dec-97
|
169 |
----------------------
|
170 |
|
171 |
1. Typos in pcre.3 and comments in the source fixed.
|
172 |
|
173 |
2. Applied a contributed patch to get rid of places where it used to remove
|
174 |
'const' from variables, and fixed some signed/unsigned and uninitialized
|
175 |
variable warnings.
|
176 |
|
177 |
3. Added the "runtest" target to Makefile.
|
178 |
|
179 |
4. Set default compiler flag to -O2 rather than just -O.
|
180 |
|
181 |
|
182 |
Version 1.01 19-Nov-97
|
183 |
----------------------
|
184 |
|
185 |
1. PCRE was failing to diagnose unlimited repeat of empty string for patterns
|
186 |
like /([ab]*)*/, that is, for classes with more than one character in them.
|
187 |
|
188 |
2. Likewise, it wasn't diagnosing patterns with "once-only" subpatterns, such
|
189 |
as /((?>a*))*/ (a PCRE_EXTRA facility).
|
190 |
|
191 |
|
192 |
Version 1.00 18-Nov-97
|
193 |
----------------------
|
194 |
|
195 |
1. Added compile-time macros to support systems such as SunOS4 which don't have
|
196 |
memmove() or strerror() but have other things that can be used instead.
|
197 |
|
198 |
2. Arranged that "make clean" removes the executables.
|
199 |
|
200 |
|
201 |
Version 0.99 27-Oct-97
|
202 |
----------------------
|
203 |
|
204 |
1. Fixed bug in code for optimizing classes with only one character. It was
|
205 |
initializing a 32-byte map regardless, which could cause it to run off the end
|
206 |
of the memory it had got.
|
207 |
|
208 |
2. Added, conditional on PCRE_EXTRA, the proposed (?>REGEX) construction.
|
209 |
|
210 |
|
211 |
Version 0.98 22-Oct-97
|
212 |
----------------------
|
213 |
|
214 |
1. Fixed bug in code for handling temporary memory usage when there are more
|
215 |
back references than supplied space in the ovector. This could cause segfaults.
|
216 |
|
217 |
|
218 |
Version 0.97 21-Oct-97
|
219 |
----------------------
|
220 |
|
221 |
1. Added the \X "cut" facility, conditional on PCRE_EXTRA.
|
222 |
|
223 |
2. Optimized negated single characters not to use a bit map.
|
224 |
|
225 |
3. Brought error texts together as macro definitions; clarified some of them;
|
226 |
fixed one that was wrong - it said "range out of order" when it meant "invalid
|
227 |
escape sequence".
|
228 |
|
229 |
4. Changed some char * arguments to const char *.
|
230 |
|
231 |
5. Added PCRE_NOTBOL and PCRE_NOTEOL (from POSIX).
|
232 |
|
233 |
6. Added the POSIX-style API wrapper in pcreposix.a and testing facilities in
|
234 |
pcretest.
|
235 |
|
236 |
|
237 |
Version 0.96 16-Oct-97
|
238 |
----------------------
|
239 |
|
240 |
1. Added a simple "pgrep" utility to the distribution.
|
241 |
|
242 |
2. Fixed an incompatibility with Perl: "{" is now treated as a normal character
|
243 |
unless it appears in one of the precise forms "{ddd}", "{ddd,}", or "{ddd,ddd}"
|
244 |
where "ddd" means "one or more decimal digits".
|
245 |
|
246 |
3. Fixed serious bug. If a pattern had a back reference, but the call to
|
247 |
pcre_exec() didn't supply a large enough ovector to record the related
|
248 |
identifying subpattern, the match always failed. PCRE now remembers the number
|
249 |
of the largest back reference, and gets some temporary memory in which to save
|
250 |
the offsets during matching if necessary, in order to ensure that
|
251 |
backreferences always work.
|
252 |
|
253 |
4. Increased the compatibility with Perl in a number of ways:
|
254 |
|
255 |
(a) . no longer matches \n by default; an option PCRE_DOTALL is provided
|
256 |
to request this handling. The option can be set at compile or exec time.
|
257 |
|
258 |
(b) $ matches before a terminating newline by default; an option
|
259 |
PCRE_DOLLAR_ENDONLY is provided to override this (but not in multiline
|
260 |
mode). The option can be set at compile or exec time.
|
261 |
|
262 |
(c) The handling of \ followed by a digit other than 0 is now supposed to be
|
263 |
the same as Perl's. If the decimal number it represents is less than 10
|
264 |
or there aren't that many previous left capturing parentheses, an octal
|
265 |
escape is read. Inside a character class, it's always an octal escape,
|
266 |
even if it is a single digit.
|
267 |
|
268 |
(d) An escaped but undefined alphabetic character is taken as a literal,
|
269 |
unless PCRE_EXTRA is set. Currently this just reserves the remaining
|
270 |
escapes.
|
271 |
|
272 |
(e) {0} is now permitted. (The previous item is removed from the compiled
|
273 |
pattern).
|
274 |
|
275 |
5. Changed all the names of code files so that the basic parts are no longer
|
276 |
than 10 characters, and abolished the teeny "globals.c" file.
|
277 |
|
278 |
6. Changed the handling of character classes; they are now done with a 32-byte
|
279 |
bit map always.
|
280 |
|
281 |
7. Added the -d and /D options to pcretest to make it possible to look at the
|
282 |
internals of compilation without having to recompile pcre.
|
283 |
|
284 |
|
285 |
Version 0.95 23-Sep-97
|
286 |
----------------------
|
287 |
|
288 |
1. Fixed bug in pre-pass concerning escaped "normal" characters such as \x5c or
|
289 |
\x20 at the start of a run of normal characters. These were being treated as
|
290 |
real characters, instead of the source characters being re-checked.
|
291 |
|
292 |
|
293 |
Version 0.94 18-Sep-97
|
294 |
----------------------
|
295 |
|
296 |
1. The functions are now thread-safe, with the caveat that the global variables
|
297 |
containing pointers to malloc() and free() or alternative functions are the
|
298 |
same for all threads.
|
299 |
|
300 |
2. Get pcre_study() to generate a bitmap of initial characters for non-
|
301 |
anchored patterns when this is possible, and use it if passed to pcre_exec().
|
302 |
|
303 |
|
304 |
Version 0.93 15-Sep-97
|
305 |
----------------------
|
306 |
|
307 |
1. /(b)|(:+)/ was computing an incorrect first character.
|
308 |
|
309 |
2. Add pcre_study() to the API and the passing of pcre_extra to pcre_exec(),
|
310 |
but not actually doing anything yet.
|
311 |
|
312 |
3. Treat "-" characters in classes that cannot be part of ranges as literals,
|
313 |
as Perl does (e.g. [-az] or [az-]).
|
314 |
|
315 |
4. Set the anchored flag if a branch starts with .* or .*? because that tests
|
316 |
all possible positions.
|
317 |
|
318 |
5. Split up into different modules to avoid including unneeded functions in a
|
319 |
compiled binary. However, compile and exec are still in one module. The "study"
|
320 |
function is split off.
|
321 |
|
322 |
6. The character tables are now in a separate module whose source is generated
|
323 |
by an auxiliary program - but can then be edited by hand if required. There are
|
324 |
now no calls to isalnum(), isspace(), isdigit(), isxdigit(), tolower() or
|
325 |
toupper() in the code.
|
326 |
|
327 |
7. Turn the malloc/free funtions variables into pcre_malloc and pcre_free and
|
328 |
make them global. Abolish the function for setting them, as the caller can now
|
329 |
set them directly.
|
330 |
|
331 |
|
332 |
Version 0.92 11-Sep-97
|
333 |
----------------------
|
334 |
|
335 |
1. A repeat with a fixed maximum and a minimum of 1 for an ordinary character
|
336 |
(e.g. /a{1,3}/) was broken (I mis-optimized it).
|
337 |
|
338 |
2. Caseless matching was not working in character classes if the characters in
|
339 |
the pattern were in upper case.
|
340 |
|
341 |
3. Make ranges like [W-c] work in the same way as Perl for caseless matching.
|
342 |
|
343 |
4. Make PCRE_ANCHORED public and accept as a compile option.
|
344 |
|
345 |
5. Add an options word to pcre_exec() and accept PCRE_ANCHORED and
|
346 |
PCRE_CASELESS at run time. Add escapes \A and \I to pcretest to cause it to
|
347 |
pass them.
|
348 |
|
349 |
6. Give an error if bad option bits passed at compile or run time.
|
350 |
|
351 |
7. Add PCRE_MULTILINE at compile and exec time, and (?m) as well. Add \M to
|
352 |
pcretest to cause it to pass that flag.
|
353 |
|
354 |
8. Add pcre_info(), to get the number of identifying subpatterns, the stored
|
355 |
options, and the first character, if set.
|
356 |
|
357 |
9. Recognize C+ or C{n,m} where n >= 1 as providing a fixed starting character.
|
358 |
|
359 |
|
360 |
Version 0.91 10-Sep-97
|
361 |
----------------------
|
362 |
|
363 |
1. PCRE was failing to diagnose unlimited repeats of subpatterns that could
|
364 |
match the empty string as in /(a*)*/. It was looping and ultimately crashing.
|
365 |
|
366 |
2. PCRE was looping on encountering an indefinitely repeated back reference to
|
367 |
a subpattern that had matched an empty string, e.g. /(a|)\1*/. It now does what
|
368 |
Perl does - treats the match as successful.
|
369 |
|
370 |
****
|