/[pcre]/code/trunk/NEWS
ViewVC logotype

Contents of /code/trunk/NEWS

Parent Directory Parent Directory | Revision Log Revision Log


Revision 1227 - (show annotations)
Fri Nov 30 10:58:52 2012 UTC (6 years, 8 months ago) by ph10
File size: 24367 byte(s)
Final updates for 8.32 release.
1 News about PCRE releases
2 ------------------------
3
4 Release 8.32 30-November-2012
5 -----------------------------
6
7 This release fixes a number of bugs, but also has some new features. These are
8 the highlights:
9
10 . There is now support for 32-bit character strings and UTF-32. Like the
11 16-bit support, this is done by compiling a separate 32-bit library.
12
13 . \X now matches a Unicode extended grapheme cluster.
14
15 . Case-independent matching of Unicode characters that have more than one
16 "other case" now makes all three (or more) characters equivalent. This
17 applies, for example, to Greek Sigma, which has two lowercase versions.
18
19 . Unicode character properties are updated to Unicode 6.2.0.
20
21 . The EBCDIC support, which had decayed, has had a spring clean.
22
23 . A number of JIT optimizations have been added, which give faster JIT
24 execution speed. In addition, a new direct interface to JIT execution is
25 available. This bypasses some of the sanity checks of pcre_exec() to give a
26 noticeable speed-up.
27
28 . A number of issues in pcregrep have been fixed, making it more compatible
29 with GNU grep. In particular, --exclude and --include (and variants) apply
30 to all files now, not just those obtained from scanning a directory
31 recursively. In Windows environments, the default action for directories is
32 now "skip" instead of "read" (which provokes an error).
33
34 . If the --only-matching (-o) option in pcregrep is specified multiple
35 times, each one causes appropriate output. For example, -o1 -o2 outputs the
36 substrings matched by the 1st and 2nd capturing parentheses. A separating
37 string can be specified by --om-separator (default empty).
38
39 . When PCRE is built via Autotools using a version of gcc that has the
40 "visibility" feature, it is used to hide internal library functions that are
41 not part of the public API.
42
43
44 Release 8.31 06-July-2012
45 -------------------------
46
47 This is mainly a bug-fixing release, with a small number of developments:
48
49 . The JIT compiler now supports partial matching and the (*MARK) and
50 (*COMMIT) verbs.
51
52 . PCRE_INFO_MAXLOOKBEHIND can be used to find the longest lookbehind in a
53 pattern.
54
55 . There should be a performance improvement when using the heap instead of the
56 stack for recursion.
57
58 . pcregrep can now be linked with libedit as an alternative to libreadline.
59
60 . pcregrep now has a --file-list option where the list of files to scan is
61 given as a file.
62
63 . pcregrep now recognizes binary files and there are related options.
64
65 . The Unicode tables have been updated to 6.1.0.
66
67 As always, the full list of changes is in the ChangeLog file.
68
69
70 Release 8.30 04-February-2012
71 -----------------------------
72
73 Release 8.30 introduces a major new feature: support for 16-bit character
74 strings, compiled as a separate library. There are a few changes to the
75 8-bit library, in addition to some bug fixes.
76
77 . The pcre_info() function, which has been obsolete for over 10 years, has
78 been removed.
79
80 . When a compiled pattern was saved to a file and later reloaded on a host
81 with different endianness, PCRE used automatically to swap the bytes in some
82 of the data fields. With the advent of the 16-bit library, where more of this
83 swapping is needed, it is no longer done automatically. Instead, the bad
84 endianness is detected and a specific error is given. The user can then call
85 a new function called pcre_pattern_to_host_byte_order() (or an equivalent
86 16-bit function) to do the swap.
87
88 . In UTF-8 mode, the values 0xd800 to 0xdfff are not legal Unicode
89 code points and are now faulted. (They are the so-called "surrogates"
90 that are reserved for coding high values in UTF-16.)
91
92
93 Release 8.21 12-Dec-2011
94 ------------------------
95
96 This is almost entirely a bug-fix release. The only new feature is the ability
97 to obtain the size of the memory used by the JIT compiler.
98
99
100 Release 8.20 21-Oct-2011
101 ------------------------
102
103 The main change in this release is the inclusion of Zoltan Herczeg's
104 just-in-time compiler support, which can be accessed by building PCRE with
105 --enable-jit. Large performance benefits can be had in many situations. 8.20
106 also fixes an unfortunate bug that was introduced in 8.13 as well as tidying up
107 a number of infelicities and differences from Perl.
108
109
110 Release 8.13 16-Aug-2011
111 ------------------------
112
113 This is mainly a bug-fix release. There has been a lot of internal refactoring.
114 The Unicode tables have been updated. The only new feature in the library is
115 the passing of *MARK information to callouts. Some additions have been made to
116 pcretest to make testing easier and more comprehensive. There is a new option
117 for pcregrep to adjust its internal buffer size.
118
119
120 Release 8.12 15-Jan-2011
121 ------------------------
122
123 This release fixes some bugs in pcregrep, one of which caused the tests to fail
124 on 64-bit big-endian systems. There are no changes to the code of the library.
125
126
127 Release 8.11 10-Dec-2010
128 ------------------------
129
130 A number of bugs in the library and in pcregrep have been fixed. As always, see
131 ChangeLog for details. The following are the non-bug-fix changes:
132
133 . Added --match-limit and --recursion-limit to pcregrep.
134
135 . Added an optional parentheses number to the -o and --only-matching options
136 of pcregrep.
137
138 . Changed the way PCRE_PARTIAL_HARD affects the matching of $, \z, \Z, \b, and
139 \B.
140
141 . Added PCRE_ERROR_SHORTUTF8 to make it possible to distinguish between a
142 bad UTF-8 sequence and one that is incomplete when using PCRE_PARTIAL_HARD.
143
144 . Recognize (*NO_START_OPT) at the start of a pattern to set the PCRE_NO_
145 START_OPTIMIZE option, which is now allowed at compile time
146
147
148 Release 8.10 25-Jun-2010
149 ------------------------
150
151 There are two major additions: support for (*MARK) and friends, and the option
152 PCRE_UCP, which changes the behaviour of \b, \d, \s, and \w (and their
153 opposites) so that they make use of Unicode properties. There are also a number
154 of lesser new features, and several bugs have been fixed. A new option,
155 --line-buffered, has been added to pcregrep, for use when it is connected to
156 pipes.
157
158
159 Release 8.02 19-Mar-2010
160 ------------------------
161
162 Another bug-fix release.
163
164
165 Release 8.01 19-Jan-2010
166 ------------------------
167
168 This is a bug-fix release. Several bugs in the code itself and some bugs and
169 infelicities in the build system have been fixed.
170
171
172 Release 8.00 19-Oct-09
173 ----------------------
174
175 Bugs have been fixed in the library and in pcregrep. There are also some
176 enhancements. Restrictions on patterns used for partial matching have been
177 removed, extra information is given for partial matches, the partial matching
178 process has been improved, and an option to make a partial match override a
179 full match is available. The "study" process has been enhanced by finding a
180 lower bound matching length. Groups with duplicate numbers may now have
181 duplicated names without the use of PCRE_DUPNAMES. However, they may not have
182 different names. The documentation has been revised to reflect these changes.
183 The version number has been expanded to 3 digits as it is clear that the rate
184 of change is not slowing down.
185
186
187 Release 7.9 11-Apr-09
188 ---------------------
189
190 Mostly bugfixes and tidies with just a couple of minor functional additions.
191
192
193 Release 7.8 05-Sep-08
194 ---------------------
195
196 More bug fixes, plus a performance improvement in Unicode character property
197 lookup.
198
199
200 Release 7.7 07-May-08
201 ---------------------
202
203 This is once again mainly a bug-fix release, but there are a couple of new
204 features.
205
206
207 Release 7.6 28-Jan-08
208 ---------------------
209
210 The main reason for having this release so soon after 7.5 is because it fixes a
211 potential buffer overflow problem in pcre_compile() when run in UTF-8 mode. In
212 addition, the CMake configuration files have been brought up to date.
213
214
215 Release 7.5 10-Jan-08
216 ---------------------
217
218 This is mainly a bug-fix release. However the ability to link pcregrep with
219 libz or libbz2 and the ability to link pcretest with libreadline have been
220 added. Also the --line-offsets and --file-offsets options were added to
221 pcregrep.
222
223
224 Release 7.4 21-Sep-07
225 ---------------------
226
227 The only change of specification is the addition of options to control whether
228 \R matches any Unicode line ending (the default) or just CR, LF, and CRLF.
229 Otherwise, the changes are bug fixes and a refactoring to reduce the number of
230 relocations needed in a shared library. There have also been some documentation
231 updates, in particular, some more information about using CMake to build PCRE
232 has been added to the NON-UNIX-USE file.
233
234
235 Release 7.3 28-Aug-07
236 ---------------------
237
238 Most changes are bug fixes. Some that are not:
239
240 1. There is some support for Perl 5.10's experimental "backtracking control
241 verbs" such as (*PRUNE).
242
243 2. UTF-8 checking is now as per RFC 3629 instead of RFC 2279; this is more
244 restrictive in the strings it accepts.
245
246 3. Checking for potential integer overflow has been made more dynamic, and as a
247 consequence there is no longer a hard limit on the size of a subpattern that
248 has a limited repeat count.
249
250 4. When CRLF is a valid line-ending sequence, pcre_exec() and pcre_dfa_exec()
251 no longer advance by two characters instead of one when an unanchored match
252 fails at CRLF if there are explicit CR or LF matches within the pattern.
253 This gets rid of some anomalous effects that previously occurred.
254
255 5. Some PCRE-specific settings for varying the newline options at the start of
256 a pattern have been added.
257
258
259 Release 7.2 19-Jun-07
260 ---------------------
261
262 WARNING: saved patterns that were compiled by earlier versions of PCRE must be
263 recompiled for use with 7.2 (necessitated by the addition of \K, \h, \H, \v,
264 and \V).
265
266 Correction to the notes for 7.1: the note about shared libraries for Windows is
267 wrong. Previously, three libraries were built, but each could function
268 independently. For example, the pcreposix library also included all the
269 functions from the basic pcre library. The change is that the three libraries
270 are no longer independent. They are like the Unix libraries. To use the
271 pcreposix functions, for example, you need to link with both the pcreposix and
272 the basic pcre library.
273
274 Some more features from Perl 5.10 have been added:
275
276 (?-n) and (?+n) relative references for recursion and subroutines.
277
278 (?(-n) and (?(+n) relative references as conditions.
279
280 \k{name} and \g{name} are synonyms for \k<name>.
281
282 \K to reset the start of the matched string; for example, (foo)\Kbar
283 matches bar preceded by foo, but only sets bar as the matched string.
284
285 (?| introduces a group where the capturing parentheses in each alternative
286 start from the same number; for example, (?|(abc)|(xyz)) sets capturing
287 parentheses number 1 in both cases.
288
289 \h, \H, \v, \V match horizontal and vertical whitespace, respectively.
290
291
292 Release 7.1 24-Apr-07
293 ---------------------
294
295 There is only one new feature in this release: a linebreak setting of
296 PCRE_NEWLINE_ANYCRLF. It is a cut-down version of PCRE_NEWLINE_ANY, which
297 recognizes only CRLF, CR, and LF as linebreaks.
298
299 A few bugs are fixed (see ChangeLog for details), but the major change is a
300 complete re-implementation of the build system. This now has full Autotools
301 support and so is now "standard" in some sense. It should help with compiling
302 PCRE in a wide variety of environments.
303
304 NOTE: when building shared libraries for Windows, three dlls are now built,
305 called libpcre, libpcreposix, and libpcrecpp. Previously, everything was
306 included in a single dll.
307
308 Another important change is that the dftables auxiliary program is no longer
309 compiled and run at "make" time by default. Instead, a default set of character
310 tables (assuming ASCII coding) is used. If you want to use dftables to generate
311 the character tables as previously, add --enable-rebuild-chartables to the
312 "configure" command. You must do this if you are compiling PCRE to run on a
313 system that uses EBCDIC code.
314
315 There is a discussion about character tables in the README file. The default is
316 not to use dftables so that that there is no problem when cross-compiling.
317
318
319 Release 7.0 19-Dec-06
320 ---------------------
321
322 This release has a new major number because there have been some internal
323 upheavals to facilitate the addition of new optimizations and other facilities,
324 and to make subsequent maintenance and extension easier. Compilation is likely
325 to be a bit slower, but there should be no major effect on runtime performance.
326 Previously compiled patterns are NOT upwards compatible with this release. If
327 you have saved compiled patterns from a previous release, you will have to
328 re-compile them. Important changes that are visible to users are:
329
330 1. The Unicode property tables have been updated to Unicode 5.0.0, which adds
331 some more scripts.
332
333 2. The option PCRE_NEWLINE_ANY causes PCRE to recognize any Unicode newline
334 sequence as a newline.
335
336 3. The \R escape matches a single Unicode newline sequence as a single unit.
337
338 4. New features that will appear in Perl 5.10 are now in PCRE. These include
339 alternative Perl syntax for named parentheses, and Perl syntax for
340 recursion.
341
342 5. The C++ wrapper interface has been extended by the addition of a
343 QuoteMeta function and the ability to allow copy construction and
344 assignment.
345
346 For a complete list of changes, see the ChangeLog file.
347
348
349 Release 6.7 04-Jul-06
350 ---------------------
351
352 The main additions to this release are the ability to use the same name for
353 multiple sets of parentheses, and support for CRLF line endings in both the
354 library and pcregrep (and in pcretest for testing).
355
356 Thanks to Ian Taylor, the stack usage for many kinds of pattern has been
357 significantly reduced for certain subject strings.
358
359
360 Release 6.5 01-Feb-06
361 ---------------------
362
363 Important changes in this release:
364
365 1. A number of new features have been added to pcregrep.
366
367 2. The Unicode property tables have been updated to Unicode 4.1.0, and the
368 supported properties have been extended with script names such as "Arabic",
369 and the derived properties "Any" and "L&". This has necessitated a change to
370 the interal format of compiled patterns. Any saved compiled patterns that
371 use \p or \P must be recompiled.
372
373 3. The specification of recursion in patterns has been changed so that all
374 recursive subpatterns are automatically treated as atomic groups. Thus, for
375 example, (?R) is treated as if it were (?>(?R)). This is necessary because
376 otherwise there are situations where recursion does not work.
377
378 See the ChangeLog for a complete list of changes, which include a number of bug
379 fixes and tidies.
380
381
382 Release 6.0 07-Jun-05
383 ---------------------
384
385 The release number has been increased to 6.0 because of the addition of several
386 major new pieces of functionality.
387
388 A new function, pcre_dfa_exec(), which implements pattern matching using a DFA
389 algorithm, has been added. This has a number of advantages for certain cases,
390 though it does run more slowly, and lacks the ability to capture substrings. On
391 the other hand, it does find all matches, not just the first, and it works
392 better for partial matching. The pcrematching man page discusses the
393 differences.
394
395 The pcretest program has been enhanced so that it can make use of the new
396 pcre_dfa_exec() matching function and the extra features it provides.
397
398 The distribution now includes a C++ wrapper library. This is built
399 automatically if a C++ compiler is found. The pcrecpp man page discusses this
400 interface.
401
402 The code itself has been re-organized into many more files, one for each
403 function, so it no longer requires everything to be linked in when static
404 linkage is used. As a consequence, some internal functions have had to have
405 their names exposed. These functions all have names starting with _pcre_. They
406 are undocumented, and are not intended for use by outside callers.
407
408 The pcregrep program has been enhanced with new functionality such as
409 multiline-matching and options for output more matching context. See the
410 ChangeLog for a complete list of changes to the library and the utility
411 programs.
412
413
414 Release 5.0 13-Sep-04
415 ---------------------
416
417 The licence under which PCRE is released has been changed to the more
418 conventional "BSD" licence.
419
420 In the code, some bugs have been fixed, and there are also some major changes
421 in this release (which is why I've increased the number to 5.0). Some changes
422 are internal rearrangements, and some provide a number of new facilities. The
423 new features are:
424
425 1. There's an "automatic callout" feature that inserts callouts before every
426 item in the regex, and there's a new callout field that gives the position
427 in the pattern - useful for debugging and tracing.
428
429 2. The extra_data structure can now be used to pass in a set of character
430 tables at exec time. This is useful if compiled regex are saved and re-used
431 at a later time when the tables may not be at the same address. If the
432 default internal tables are used, the pointer saved with the compiled
433 pattern is now set to NULL, which means that you don't need to do anything
434 special unless you are using custom tables.
435
436 3. It is possible, with some restrictions on the content of the regex, to
437 request "partial" matching. A special return code is given if all of the
438 subject string matched part of the regex. This could be useful for testing
439 an input field as it is being typed.
440
441 4. There is now some optional support for Unicode character properties, which
442 means that the patterns items such as \p{Lu} and \X can now be used. Only
443 the general category properties are supported. If PCRE is compiled with this
444 support, an additional 90K data structure is include, which increases the
445 size of the library dramatically.
446
447 5. There is support for saving compiled patterns and re-using them later.
448
449 6. There is support for running regular expressions that were compiled on a
450 different host with the opposite endianness.
451
452 7. The pcretest program has been extended to accommodate the new features.
453
454 The main internal rearrangement is that sequences of literal characters are no
455 longer handled as strings. Instead, each character is handled on its own. This
456 makes some UTF-8 handling easier, and makes the support of partial matching
457 possible. Compiled patterns containing long literal strings will be larger as a
458 result of this change; I hope that performance will not be much affected.
459
460
461 Release 4.5 01-Dec-03
462 ---------------------
463
464 Again mainly a bug-fix and tidying release, with only a couple of new features:
465
466 1. It's possible now to compile PCRE so that it does not use recursive
467 function calls when matching. Instead it gets memory from the heap. This slows
468 things down, but may be necessary on systems with limited stacks.
469
470 2. UTF-8 string checking has been tightened to reject overlong sequences and to
471 check that a starting offset points to the start of a character. Failure of the
472 latter returns a new error code: PCRE_ERROR_BADUTF8_OFFSET.
473
474 3. PCRE can now be compiled for systems that use EBCDIC code.
475
476
477 Release 4.4 21-Aug-03
478 ---------------------
479
480 This is mainly a bug-fix and tidying release. The only new feature is that PCRE
481 checks UTF-8 strings for validity by default. There is an option to suppress
482 this, just in case anybody wants that teeny extra bit of performance.
483
484
485 Releases 4.1 - 4.3
486 ------------------
487
488 Sorry, I forgot about updating the NEWS file for these releases. Please take a
489 look at ChangeLog.
490
491
492 Release 4.0 17-Feb-03
493 ---------------------
494
495 There have been a lot of changes for the 4.0 release, adding additional
496 functionality and mending bugs. Below is a list of the highlights of the new
497 functionality. For full details of these features, please consult the
498 documentation. For a complete list of changes, see the ChangeLog file.
499
500 1. Support for Perl's \Q...\E escapes.
501
502 2. "Possessive quantifiers" ?+, *+, ++, and {,}+ which come from Sun's Java
503 package. They provide some syntactic sugar for simple cases of "atomic
504 grouping".
505
506 3. Support for the \G assertion. It is true when the current matching position
507 is at the start point of the match.
508
509 4. A new feature that provides some of the functionality that Perl provides
510 with (?{...}). The facility is termed a "callout". The way it is done in PCRE
511 is for the caller to provide an optional function, by setting pcre_callout to
512 its entry point. To get the function called, the regex must include (?C) at
513 appropriate points.
514
515 5. Support for recursive calls to individual subpatterns. This makes it really
516 easy to get totally confused.
517
518 6. Support for named subpatterns. The Python syntax (?P<name>...) is used to
519 name a group.
520
521 7. Several extensions to UTF-8 support; it is now fairly complete. There is an
522 option for pcregrep to make it operate in UTF-8 mode.
523
524 8. The single man page has been split into a number of separate man pages.
525 These also give rise to individual HTML pages which are put in a separate
526 directory. There is an index.html page that lists them all. Some hyperlinking
527 between the pages has been installed.
528
529
530 Release 3.5 15-Aug-01
531 ---------------------
532
533 1. The configuring system has been upgraded to use later versions of autoconf
534 and libtool. By default it builds both a shared and a static library if the OS
535 supports it. You can use --disable-shared or --disable-static on the configure
536 command if you want only one of them.
537
538 2. The pcretest utility is now installed along with pcregrep because it is
539 useful for users (to test regexs) and by doing this, it automatically gets
540 relinked by libtool. The documentation has been turned into a man page, so
541 there are now .1, .txt, and .html versions in /doc.
542
543 3. Upgrades to pcregrep:
544 (i) Added long-form option names like gnu grep.
545 (ii) Added --help to list all options with an explanatory phrase.
546 (iii) Added -r, --recursive to recurse into sub-directories.
547 (iv) Added -f, --file to read patterns from a file.
548
549 4. Added --enable-newline-is-cr and --enable-newline-is-lf to the configure
550 script, to force use of CR or LF instead of \n in the source. On non-Unix
551 systems, the value can be set in config.h.
552
553 5. The limit of 200 on non-capturing parentheses is a _nesting_ limit, not an
554 absolute limit. Changed the text of the error message to make this clear, and
555 likewise updated the man page.
556
557 6. The limit of 99 on the number of capturing subpatterns has been removed.
558 The new limit is 65535, which I hope will not be a "real" limit.
559
560
561 Release 3.3 01-Aug-00
562 ---------------------
563
564 There is some support for UTF-8 character strings. This is incomplete and
565 experimental. The documentation describes what is and what is not implemented.
566 Otherwise, this is just a bug-fixing release.
567
568
569 Release 3.0 01-Feb-00
570 ---------------------
571
572 1. A "configure" script is now used to configure PCRE for Unix systems. It
573 builds a Makefile, a config.h file, and the pcre-config script.
574
575 2. PCRE is built as a shared library by default.
576
577 3. There is support for POSIX classes such as [:alpha:].
578
579 5. There is an experimental recursion feature.
580
581 ----------------------------------------------------------------------------
582 IMPORTANT FOR THOSE UPGRADING FROM VERSIONS BEFORE 2.00
583
584 Please note that there has been a change in the API such that a larger
585 ovector is required at matching time, to provide some additional workspace.
586 The new man page has details. This change was necessary in order to support
587 some of the new functionality in Perl 5.005.
588
589 IMPORTANT FOR THOSE UPGRADING FROM VERSION 2.00
590
591 Another (I hope this is the last!) change has been made to the API for the
592 pcre_compile() function. An additional argument has been added to make it
593 possible to pass over a pointer to character tables built in the current
594 locale by pcre_maketables(). To use the default tables, this new arguement
595 should be passed as NULL.
596
597 IMPORTANT FOR THOSE UPGRADING FROM VERSION 2.05
598
599 Yet another (and again I hope this really is the last) change has been made
600 to the API for the pcre_exec() function. An additional argument has been
601 added to make it possible to start the match other than at the start of the
602 subject string. This is important if there are lookbehinds. The new man
603 page has the details, but you just want to convert existing programs, all
604 you need to do is to stick in a new fifth argument to pcre_exec(), with a
605 value of zero. For example, change
606
607 pcre_exec(pattern, extra, subject, length, options, ovec, ovecsize)
608 to
609 pcre_exec(pattern, extra, subject, length, 0, options, ovec, ovecsize)
610
611 ****

Properties

Name Value
svn:eol-style native
svn:keywords "Author Date Id Revision Url"

  ViewVC Help
Powered by ViewVC 1.1.5