/[pcre]/code/trunk/NEWS
ViewVC logotype

Contents of /code/trunk/NEWS

Parent Directory Parent Directory | Revision Log Revision Log


Revision 1003 - (show annotations)
Wed Aug 15 16:45:36 2012 UTC (7 years, 1 month ago) by ph10
File size: 22980 byte(s)
Fix a number of issues in pcregrep.
1 News about PCRE releases
2 ------------------------
3
4 Release 8.32 xx-xxxx-2012
5 -------------------------
6
7 . A number of issues in pcregrep have been fixed, making it more compatible
8 with GNU grep. In particular, --exclude and --include (and variants) apply
9 to all files now, not just those obtained from scanning a directory
10 recursively. In Windows environments, the default action for directories is
11 now "skip" instead of "read" (which provokes an error).
12
13
14 Release 8.31 06-July-2012
15 -------------------------
16
17 This is mainly a bug-fixing release, with a small number of developments:
18
19 . The JIT compiler now supports partial matching and the (*MARK) and
20 (*COMMIT) verbs.
21
22 . PCRE_INFO_MAXLOOKBEHIND can be used to find the longest lookbehind in a
23 pattern.
24
25 . There should be a performance improvement when using the heap instead of the
26 stack for recursion.
27
28 . pcregrep can now be linked with libedit as an alternative to libreadline.
29
30 . pcregrep now has a --file-list option where the list of files to scan is
31 given as a file.
32
33 . pcregrep now recognizes binary files and there are related options.
34
35 . The Unicode tables have been updated to 6.1.0.
36
37 As always, the full list of changes is in the ChangeLog file.
38
39
40 Release 8.30 04-February-2012
41 -----------------------------
42
43 Release 8.30 introduces a major new feature: support for 16-bit character
44 strings, compiled as a separate library. There are a few changes to the
45 8-bit library, in addition to some bug fixes.
46
47 . The pcre_info() function, which has been obsolete for over 10 years, has
48 been removed.
49
50 . When a compiled pattern was saved to a file and later reloaded on a host
51 with different endianness, PCRE used automatically to swap the bytes in some
52 of the data fields. With the advent of the 16-bit library, where more of this
53 swapping is needed, it is no longer done automatically. Instead, the bad
54 endianness is detected and a specific error is given. The user can then call
55 a new function called pcre_pattern_to_host_byte_order() (or an equivalent
56 16-bit function) to do the swap.
57
58 . In UTF-8 mode, the values 0xd800 to 0xdfff are not legal Unicode
59 code points and are now faulted. (They are the so-called "surrogates"
60 that are reserved for coding high values in UTF-16.)
61
62
63 Release 8.21 12-Dec-2011
64 ------------------------
65
66 This is almost entirely a bug-fix release. The only new feature is the ability
67 to obtain the size of the memory used by the JIT compiler.
68
69
70 Release 8.20 21-Oct-2011
71 ------------------------
72
73 The main change in this release is the inclusion of Zoltan Herczeg's
74 just-in-time compiler support, which can be accessed by building PCRE with
75 --enable-jit. Large performance benefits can be had in many situations. 8.20
76 also fixes an unfortunate bug that was introduced in 8.13 as well as tidying up
77 a number of infelicities and differences from Perl.
78
79
80 Release 8.13 16-Aug-2011
81 ------------------------
82
83 This is mainly a bug-fix release. There has been a lot of internal refactoring.
84 The Unicode tables have been updated. The only new feature in the library is
85 the passing of *MARK information to callouts. Some additions have been made to
86 pcretest to make testing easier and more comprehensive. There is a new option
87 for pcregrep to adjust its internal buffer size.
88
89
90 Release 8.12 15-Jan-2011
91 ------------------------
92
93 This release fixes some bugs in pcregrep, one of which caused the tests to fail
94 on 64-bit big-endian systems. There are no changes to the code of the library.
95
96
97 Release 8.11 10-Dec-2010
98 ------------------------
99
100 A number of bugs in the library and in pcregrep have been fixed. As always, see
101 ChangeLog for details. The following are the non-bug-fix changes:
102
103 . Added --match-limit and --recursion-limit to pcregrep.
104
105 . Added an optional parentheses number to the -o and --only-matching options
106 of pcregrep.
107
108 . Changed the way PCRE_PARTIAL_HARD affects the matching of $, \z, \Z, \b, and
109 \B.
110
111 . Added PCRE_ERROR_SHORTUTF8 to make it possible to distinguish between a
112 bad UTF-8 sequence and one that is incomplete when using PCRE_PARTIAL_HARD.
113
114 . Recognize (*NO_START_OPT) at the start of a pattern to set the PCRE_NO_
115 START_OPTIMIZE option, which is now allowed at compile time
116
117
118 Release 8.10 25-Jun-2010
119 ------------------------
120
121 There are two major additions: support for (*MARK) and friends, and the option
122 PCRE_UCP, which changes the behaviour of \b, \d, \s, and \w (and their
123 opposites) so that they make use of Unicode properties. There are also a number
124 of lesser new features, and several bugs have been fixed. A new option,
125 --line-buffered, has been added to pcregrep, for use when it is connected to
126 pipes.
127
128
129 Release 8.02 19-Mar-2010
130 ------------------------
131
132 Another bug-fix release.
133
134
135 Release 8.01 19-Jan-2010
136 ------------------------
137
138 This is a bug-fix release. Several bugs in the code itself and some bugs and
139 infelicities in the build system have been fixed.
140
141
142 Release 8.00 19-Oct-09
143 ----------------------
144
145 Bugs have been fixed in the library and in pcregrep. There are also some
146 enhancements. Restrictions on patterns used for partial matching have been
147 removed, extra information is given for partial matches, the partial matching
148 process has been improved, and an option to make a partial match override a
149 full match is available. The "study" process has been enhanced by finding a
150 lower bound matching length. Groups with duplicate numbers may now have
151 duplicated names without the use of PCRE_DUPNAMES. However, they may not have
152 different names. The documentation has been revised to reflect these changes.
153 The version number has been expanded to 3 digits as it is clear that the rate
154 of change is not slowing down.
155
156
157 Release 7.9 11-Apr-09
158 ---------------------
159
160 Mostly bugfixes and tidies with just a couple of minor functional additions.
161
162
163 Release 7.8 05-Sep-08
164 ---------------------
165
166 More bug fixes, plus a performance improvement in Unicode character property
167 lookup.
168
169
170 Release 7.7 07-May-08
171 ---------------------
172
173 This is once again mainly a bug-fix release, but there are a couple of new
174 features.
175
176
177 Release 7.6 28-Jan-08
178 ---------------------
179
180 The main reason for having this release so soon after 7.5 is because it fixes a
181 potential buffer overflow problem in pcre_compile() when run in UTF-8 mode. In
182 addition, the CMake configuration files have been brought up to date.
183
184
185 Release 7.5 10-Jan-08
186 ---------------------
187
188 This is mainly a bug-fix release. However the ability to link pcregrep with
189 libz or libbz2 and the ability to link pcretest with libreadline have been
190 added. Also the --line-offsets and --file-offsets options were added to
191 pcregrep.
192
193
194 Release 7.4 21-Sep-07
195 ---------------------
196
197 The only change of specification is the addition of options to control whether
198 \R matches any Unicode line ending (the default) or just CR, LF, and CRLF.
199 Otherwise, the changes are bug fixes and a refactoring to reduce the number of
200 relocations needed in a shared library. There have also been some documentation
201 updates, in particular, some more information about using CMake to build PCRE
202 has been added to the NON-UNIX-USE file.
203
204
205 Release 7.3 28-Aug-07
206 ---------------------
207
208 Most changes are bug fixes. Some that are not:
209
210 1. There is some support for Perl 5.10's experimental "backtracking control
211 verbs" such as (*PRUNE).
212
213 2. UTF-8 checking is now as per RFC 3629 instead of RFC 2279; this is more
214 restrictive in the strings it accepts.
215
216 3. Checking for potential integer overflow has been made more dynamic, and as a
217 consequence there is no longer a hard limit on the size of a subpattern that
218 has a limited repeat count.
219
220 4. When CRLF is a valid line-ending sequence, pcre_exec() and pcre_dfa_exec()
221 no longer advance by two characters instead of one when an unanchored match
222 fails at CRLF if there are explicit CR or LF matches within the pattern.
223 This gets rid of some anomalous effects that previously occurred.
224
225 5. Some PCRE-specific settings for varying the newline options at the start of
226 a pattern have been added.
227
228
229 Release 7.2 19-Jun-07
230 ---------------------
231
232 WARNING: saved patterns that were compiled by earlier versions of PCRE must be
233 recompiled for use with 7.2 (necessitated by the addition of \K, \h, \H, \v,
234 and \V).
235
236 Correction to the notes for 7.1: the note about shared libraries for Windows is
237 wrong. Previously, three libraries were built, but each could function
238 independently. For example, the pcreposix library also included all the
239 functions from the basic pcre library. The change is that the three libraries
240 are no longer independent. They are like the Unix libraries. To use the
241 pcreposix functions, for example, you need to link with both the pcreposix and
242 the basic pcre library.
243
244 Some more features from Perl 5.10 have been added:
245
246 (?-n) and (?+n) relative references for recursion and subroutines.
247
248 (?(-n) and (?(+n) relative references as conditions.
249
250 \k{name} and \g{name} are synonyms for \k<name>.
251
252 \K to reset the start of the matched string; for example, (foo)\Kbar
253 matches bar preceded by foo, but only sets bar as the matched string.
254
255 (?| introduces a group where the capturing parentheses in each alternative
256 start from the same number; for example, (?|(abc)|(xyz)) sets capturing
257 parentheses number 1 in both cases.
258
259 \h, \H, \v, \V match horizontal and vertical whitespace, respectively.
260
261
262 Release 7.1 24-Apr-07
263 ---------------------
264
265 There is only one new feature in this release: a linebreak setting of
266 PCRE_NEWLINE_ANYCRLF. It is a cut-down version of PCRE_NEWLINE_ANY, which
267 recognizes only CRLF, CR, and LF as linebreaks.
268
269 A few bugs are fixed (see ChangeLog for details), but the major change is a
270 complete re-implementation of the build system. This now has full Autotools
271 support and so is now "standard" in some sense. It should help with compiling
272 PCRE in a wide variety of environments.
273
274 NOTE: when building shared libraries for Windows, three dlls are now built,
275 called libpcre, libpcreposix, and libpcrecpp. Previously, everything was
276 included in a single dll.
277
278 Another important change is that the dftables auxiliary program is no longer
279 compiled and run at "make" time by default. Instead, a default set of character
280 tables (assuming ASCII coding) is used. If you want to use dftables to generate
281 the character tables as previously, add --enable-rebuild-chartables to the
282 "configure" command. You must do this if you are compiling PCRE to run on a
283 system that uses EBCDIC code.
284
285 There is a discussion about character tables in the README file. The default is
286 not to use dftables so that that there is no problem when cross-compiling.
287
288
289 Release 7.0 19-Dec-06
290 ---------------------
291
292 This release has a new major number because there have been some internal
293 upheavals to facilitate the addition of new optimizations and other facilities,
294 and to make subsequent maintenance and extension easier. Compilation is likely
295 to be a bit slower, but there should be no major effect on runtime performance.
296 Previously compiled patterns are NOT upwards compatible with this release. If
297 you have saved compiled patterns from a previous release, you will have to
298 re-compile them. Important changes that are visible to users are:
299
300 1. The Unicode property tables have been updated to Unicode 5.0.0, which adds
301 some more scripts.
302
303 2. The option PCRE_NEWLINE_ANY causes PCRE to recognize any Unicode newline
304 sequence as a newline.
305
306 3. The \R escape matches a single Unicode newline sequence as a single unit.
307
308 4. New features that will appear in Perl 5.10 are now in PCRE. These include
309 alternative Perl syntax for named parentheses, and Perl syntax for
310 recursion.
311
312 5. The C++ wrapper interface has been extended by the addition of a
313 QuoteMeta function and the ability to allow copy construction and
314 assignment.
315
316 For a complete list of changes, see the ChangeLog file.
317
318
319 Release 6.7 04-Jul-06
320 ---------------------
321
322 The main additions to this release are the ability to use the same name for
323 multiple sets of parentheses, and support for CRLF line endings in both the
324 library and pcregrep (and in pcretest for testing).
325
326 Thanks to Ian Taylor, the stack usage for many kinds of pattern has been
327 significantly reduced for certain subject strings.
328
329
330 Release 6.5 01-Feb-06
331 ---------------------
332
333 Important changes in this release:
334
335 1. A number of new features have been added to pcregrep.
336
337 2. The Unicode property tables have been updated to Unicode 4.1.0, and the
338 supported properties have been extended with script names such as "Arabic",
339 and the derived properties "Any" and "L&". This has necessitated a change to
340 the interal format of compiled patterns. Any saved compiled patterns that
341 use \p or \P must be recompiled.
342
343 3. The specification of recursion in patterns has been changed so that all
344 recursive subpatterns are automatically treated as atomic groups. Thus, for
345 example, (?R) is treated as if it were (?>(?R)). This is necessary because
346 otherwise there are situations where recursion does not work.
347
348 See the ChangeLog for a complete list of changes, which include a number of bug
349 fixes and tidies.
350
351
352 Release 6.0 07-Jun-05
353 ---------------------
354
355 The release number has been increased to 6.0 because of the addition of several
356 major new pieces of functionality.
357
358 A new function, pcre_dfa_exec(), which implements pattern matching using a DFA
359 algorithm, has been added. This has a number of advantages for certain cases,
360 though it does run more slowly, and lacks the ability to capture substrings. On
361 the other hand, it does find all matches, not just the first, and it works
362 better for partial matching. The pcrematching man page discusses the
363 differences.
364
365 The pcretest program has been enhanced so that it can make use of the new
366 pcre_dfa_exec() matching function and the extra features it provides.
367
368 The distribution now includes a C++ wrapper library. This is built
369 automatically if a C++ compiler is found. The pcrecpp man page discusses this
370 interface.
371
372 The code itself has been re-organized into many more files, one for each
373 function, so it no longer requires everything to be linked in when static
374 linkage is used. As a consequence, some internal functions have had to have
375 their names exposed. These functions all have names starting with _pcre_. They
376 are undocumented, and are not intended for use by outside callers.
377
378 The pcregrep program has been enhanced with new functionality such as
379 multiline-matching and options for output more matching context. See the
380 ChangeLog for a complete list of changes to the library and the utility
381 programs.
382
383
384 Release 5.0 13-Sep-04
385 ---------------------
386
387 The licence under which PCRE is released has been changed to the more
388 conventional "BSD" licence.
389
390 In the code, some bugs have been fixed, and there are also some major changes
391 in this release (which is why I've increased the number to 5.0). Some changes
392 are internal rearrangements, and some provide a number of new facilities. The
393 new features are:
394
395 1. There's an "automatic callout" feature that inserts callouts before every
396 item in the regex, and there's a new callout field that gives the position
397 in the pattern - useful for debugging and tracing.
398
399 2. The extra_data structure can now be used to pass in a set of character
400 tables at exec time. This is useful if compiled regex are saved and re-used
401 at a later time when the tables may not be at the same address. If the
402 default internal tables are used, the pointer saved with the compiled
403 pattern is now set to NULL, which means that you don't need to do anything
404 special unless you are using custom tables.
405
406 3. It is possible, with some restrictions on the content of the regex, to
407 request "partial" matching. A special return code is given if all of the
408 subject string matched part of the regex. This could be useful for testing
409 an input field as it is being typed.
410
411 4. There is now some optional support for Unicode character properties, which
412 means that the patterns items such as \p{Lu} and \X can now be used. Only
413 the general category properties are supported. If PCRE is compiled with this
414 support, an additional 90K data structure is include, which increases the
415 size of the library dramatically.
416
417 5. There is support for saving compiled patterns and re-using them later.
418
419 6. There is support for running regular expressions that were compiled on a
420 different host with the opposite endianness.
421
422 7. The pcretest program has been extended to accommodate the new features.
423
424 The main internal rearrangement is that sequences of literal characters are no
425 longer handled as strings. Instead, each character is handled on its own. This
426 makes some UTF-8 handling easier, and makes the support of partial matching
427 possible. Compiled patterns containing long literal strings will be larger as a
428 result of this change; I hope that performance will not be much affected.
429
430
431 Release 4.5 01-Dec-03
432 ---------------------
433
434 Again mainly a bug-fix and tidying release, with only a couple of new features:
435
436 1. It's possible now to compile PCRE so that it does not use recursive
437 function calls when matching. Instead it gets memory from the heap. This slows
438 things down, but may be necessary on systems with limited stacks.
439
440 2. UTF-8 string checking has been tightened to reject overlong sequences and to
441 check that a starting offset points to the start of a character. Failure of the
442 latter returns a new error code: PCRE_ERROR_BADUTF8_OFFSET.
443
444 3. PCRE can now be compiled for systems that use EBCDIC code.
445
446
447 Release 4.4 21-Aug-03
448 ---------------------
449
450 This is mainly a bug-fix and tidying release. The only new feature is that PCRE
451 checks UTF-8 strings for validity by default. There is an option to suppress
452 this, just in case anybody wants that teeny extra bit of performance.
453
454
455 Releases 4.1 - 4.3
456 ------------------
457
458 Sorry, I forgot about updating the NEWS file for these releases. Please take a
459 look at ChangeLog.
460
461
462 Release 4.0 17-Feb-03
463 ---------------------
464
465 There have been a lot of changes for the 4.0 release, adding additional
466 functionality and mending bugs. Below is a list of the highlights of the new
467 functionality. For full details of these features, please consult the
468 documentation. For a complete list of changes, see the ChangeLog file.
469
470 1. Support for Perl's \Q...\E escapes.
471
472 2. "Possessive quantifiers" ?+, *+, ++, and {,}+ which come from Sun's Java
473 package. They provide some syntactic sugar for simple cases of "atomic
474 grouping".
475
476 3. Support for the \G assertion. It is true when the current matching position
477 is at the start point of the match.
478
479 4. A new feature that provides some of the functionality that Perl provides
480 with (?{...}). The facility is termed a "callout". The way it is done in PCRE
481 is for the caller to provide an optional function, by setting pcre_callout to
482 its entry point. To get the function called, the regex must include (?C) at
483 appropriate points.
484
485 5. Support for recursive calls to individual subpatterns. This makes it really
486 easy to get totally confused.
487
488 6. Support for named subpatterns. The Python syntax (?P<name>...) is used to
489 name a group.
490
491 7. Several extensions to UTF-8 support; it is now fairly complete. There is an
492 option for pcregrep to make it operate in UTF-8 mode.
493
494 8. The single man page has been split into a number of separate man pages.
495 These also give rise to individual HTML pages which are put in a separate
496 directory. There is an index.html page that lists them all. Some hyperlinking
497 between the pages has been installed.
498
499
500 Release 3.5 15-Aug-01
501 ---------------------
502
503 1. The configuring system has been upgraded to use later versions of autoconf
504 and libtool. By default it builds both a shared and a static library if the OS
505 supports it. You can use --disable-shared or --disable-static on the configure
506 command if you want only one of them.
507
508 2. The pcretest utility is now installed along with pcregrep because it is
509 useful for users (to test regexs) and by doing this, it automatically gets
510 relinked by libtool. The documentation has been turned into a man page, so
511 there are now .1, .txt, and .html versions in /doc.
512
513 3. Upgrades to pcregrep:
514 (i) Added long-form option names like gnu grep.
515 (ii) Added --help to list all options with an explanatory phrase.
516 (iii) Added -r, --recursive to recurse into sub-directories.
517 (iv) Added -f, --file to read patterns from a file.
518
519 4. Added --enable-newline-is-cr and --enable-newline-is-lf to the configure
520 script, to force use of CR or LF instead of \n in the source. On non-Unix
521 systems, the value can be set in config.h.
522
523 5. The limit of 200 on non-capturing parentheses is a _nesting_ limit, not an
524 absolute limit. Changed the text of the error message to make this clear, and
525 likewise updated the man page.
526
527 6. The limit of 99 on the number of capturing subpatterns has been removed.
528 The new limit is 65535, which I hope will not be a "real" limit.
529
530
531 Release 3.3 01-Aug-00
532 ---------------------
533
534 There is some support for UTF-8 character strings. This is incomplete and
535 experimental. The documentation describes what is and what is not implemented.
536 Otherwise, this is just a bug-fixing release.
537
538
539 Release 3.0 01-Feb-00
540 ---------------------
541
542 1. A "configure" script is now used to configure PCRE for Unix systems. It
543 builds a Makefile, a config.h file, and the pcre-config script.
544
545 2. PCRE is built as a shared library by default.
546
547 3. There is support for POSIX classes such as [:alpha:].
548
549 5. There is an experimental recursion feature.
550
551 ----------------------------------------------------------------------------
552 IMPORTANT FOR THOSE UPGRADING FROM VERSIONS BEFORE 2.00
553
554 Please note that there has been a change in the API such that a larger
555 ovector is required at matching time, to provide some additional workspace.
556 The new man page has details. This change was necessary in order to support
557 some of the new functionality in Perl 5.005.
558
559 IMPORTANT FOR THOSE UPGRADING FROM VERSION 2.00
560
561 Another (I hope this is the last!) change has been made to the API for the
562 pcre_compile() function. An additional argument has been added to make it
563 possible to pass over a pointer to character tables built in the current
564 locale by pcre_maketables(). To use the default tables, this new arguement
565 should be passed as NULL.
566
567 IMPORTANT FOR THOSE UPGRADING FROM VERSION 2.05
568
569 Yet another (and again I hope this really is the last) change has been made
570 to the API for the pcre_exec() function. An additional argument has been
571 added to make it possible to start the match other than at the start of the
572 subject string. This is important if there are lookbehinds. The new man
573 page has the details, but you just want to convert existing programs, all
574 you need to do is to stick in a new fifth argument to pcre_exec(), with a
575 value of zero. For example, change
576
577 pcre_exec(pattern, extra, subject, length, options, ovec, ovecsize)
578 to
579 pcre_exec(pattern, extra, subject, length, 0, options, ovec, ovecsize)
580
581 ****

Properties

Name Value
svn:eol-style native
svn:keywords "Author Date Id Revision Url"

  ViewVC Help
Powered by ViewVC 1.1.5