18 |
<li><a name="TOC3" href="#SEC3">LIMITATIONS</a> |
<li><a name="TOC3" href="#SEC3">LIMITATIONS</a> |
19 |
<li><a name="TOC4" href="#SEC4">UTF-8 AND UNICODE PROPERTY SUPPORT</a> |
<li><a name="TOC4" href="#SEC4">UTF-8 AND UNICODE PROPERTY SUPPORT</a> |
20 |
<li><a name="TOC5" href="#SEC5">AUTHOR</a> |
<li><a name="TOC5" href="#SEC5">AUTHOR</a> |
21 |
|
<li><a name="TOC6" href="#SEC6">REVISION</a> |
22 |
</ul> |
</ul> |
23 |
<br><a name="SEC1" href="#TOC1">INTRODUCTION</a><br> |
<br><a name="SEC1" href="#TOC1">INTRODUCTION</a><br> |
24 |
<P> |
<P> |
25 |
The PCRE library is a set of functions that implement regular expression |
The PCRE library is a set of functions that implement regular expression |
26 |
pattern matching using the same syntax and semantics as Perl, with just a few |
pattern matching using the same syntax and semantics as Perl, with just a few |
27 |
differences. The current implementation of PCRE (release 5.x) corresponds |
differences. (Certain features that appeared in Python and PCRE before they |
28 |
approximately with Perl 5.8, including support for UTF-8 encoded strings and |
appeared in Perl are also available using the Python syntax.) |
29 |
Unicode general category properties. However, this support has to be explicitly |
</P> |
30 |
enabled; it is not the default. |
<P> |
31 |
|
The current implementation of PCRE (release 7.x) corresponds approximately with |
32 |
|
Perl 5.10, including support for UTF-8 encoded strings and Unicode general |
33 |
|
category properties. However, UTF-8 and Unicode support has to be explicitly |
34 |
|
enabled; it is not the default. The Unicode tables correspond to Unicode |
35 |
|
release 5.0.0. |
36 |
|
</P> |
37 |
|
<P> |
38 |
|
In addition to the Perl-compatible matching function, PCRE contains an |
39 |
|
alternative matching function that matches the same compiled patterns in a |
40 |
|
different way. In certain circumstances, the alternative function has some |
41 |
|
advantages. For a discussion of the two matching algorithms, see the |
42 |
|
<a href="pcrematching.html"><b>pcrematching</b></a> |
43 |
|
page. |
44 |
</P> |
</P> |
45 |
<P> |
<P> |
46 |
PCRE is written in C and released as a C library. A number of people have |
PCRE is written in C and released as a C library. A number of people have |
47 |
written wrappers and interfaces of various kinds. A C++ class is included in |
written wrappers and interfaces of various kinds. In particular, Google Inc. |
48 |
these contributions, which can be found in the <i>Contrib</i> directory at the |
have provided a comprehensive C++ wrapper. This is now included as part of the |
49 |
primary FTP site, which is: |
PCRE distribution. The |
50 |
|
<a href="pcrecpp.html"><b>pcrecpp</b></a> |
51 |
|
page has details of this interface. Other people's contributions can be found |
52 |
|
in the <i>Contrib</i> directory at the primary FTP site, which is: |
53 |
<a href="ftp://ftp.csx.cam.ac.uk/pub/software/programming/pcre">ftp://ftp.csx.cam.ac.uk/pub/software/programming/pcre</a> |
<a href="ftp://ftp.csx.cam.ac.uk/pub/software/programming/pcre">ftp://ftp.csx.cam.ac.uk/pub/software/programming/pcre</a> |
54 |
</P> |
</P> |
55 |
<P> |
<P> |
70 |
page. Documentation about building PCRE for various operating systems can be |
page. Documentation about building PCRE for various operating systems can be |
71 |
found in the <b>README</b> file in the source distribution. |
found in the <b>README</b> file in the source distribution. |
72 |
</P> |
</P> |
73 |
|
<P> |
74 |
|
The library contains a number of undocumented internal functions and data |
75 |
|
tables that are used by more than one of the exported external functions, but |
76 |
|
which are not intended for use by external callers. Their names all begin with |
77 |
|
"_pcre_", which hopefully will not provoke any name clashes. In some |
78 |
|
environments, it is possible to control which external symbols are exported |
79 |
|
when a shared library is built, and in these cases the undocumented symbols are |
80 |
|
not exported. |
81 |
|
</P> |
82 |
<br><a name="SEC2" href="#TOC1">USER DOCUMENTATION</a><br> |
<br><a name="SEC2" href="#TOC1">USER DOCUMENTATION</a><br> |
83 |
<P> |
<P> |
84 |
The user documentation for PCRE comprises a number of different sections. In |
The user documentation for PCRE comprises a number of different sections. In |
88 |
follows: |
follows: |
89 |
<pre> |
<pre> |
90 |
pcre this document |
pcre this document |
91 |
pcreapi details of PCRE's native API |
pcre-config show PCRE installation configuration information |
92 |
|
pcreapi details of PCRE's native C API |
93 |
pcrebuild options for building PCRE |
pcrebuild options for building PCRE |
94 |
pcrecallout details of the callout feature |
pcrecallout details of the callout feature |
95 |
pcrecompat discussion of Perl compatibility |
pcrecompat discussion of Perl compatibility |
96 |
|
pcrecpp details of the C++ wrapper |
97 |
pcregrep description of the <b>pcregrep</b> command |
pcregrep description of the <b>pcregrep</b> command |
98 |
|
pcrematching discussion of the two matching algorithms |
99 |
pcrepartial details of the partial matching facility |
pcrepartial details of the partial matching facility |
100 |
pcrepattern syntax and semantics of supported regular expressions |
pcrepattern syntax and semantics of supported regular expressions |
101 |
pcreperform discussion of performance issues |
pcreperform discussion of performance issues |
102 |
pcreposix the POSIX-compatible API |
pcreposix the POSIX-compatible C API |
103 |
pcreprecompile details of saving and re-using precompiled patterns |
pcreprecompile details of saving and re-using precompiled patterns |
104 |
pcresample discussion of the sample program |
pcresample discussion of the sample program |
105 |
|
pcrestack discussion of stack usage |
106 |
pcretest description of the <b>pcretest</b> testing command |
pcretest description of the <b>pcretest</b> testing command |
107 |
</pre> |
</pre> |
108 |
In addition, in the "man" and HTML formats, there is a short page for each |
In addition, in the "man" and HTML formats, there is a short page for each |
109 |
library function, listing its arguments and results. |
C library function, listing its arguments and results. |
110 |
</P> |
</P> |
111 |
<br><a name="SEC3" href="#TOC1">LIMITATIONS</a><br> |
<br><a name="SEC3" href="#TOC1">LIMITATIONS</a><br> |
112 |
<P> |
<P> |
121 |
distribution and the |
distribution and the |
122 |
<a href="pcrebuild.html"><b>pcrebuild</b></a> |
<a href="pcrebuild.html"><b>pcrebuild</b></a> |
123 |
documentation for details). In these cases the limit is substantially larger. |
documentation for details). In these cases the limit is substantially larger. |
124 |
However, the speed of execution will be slower. |
However, the speed of execution is slower. |
125 |
|
</P> |
126 |
|
<P> |
127 |
|
All values in repeating quantifiers must be less than 65536. The maximum |
128 |
|
compiled length of subpattern with an explicit repeat count is 30000 bytes. The |
129 |
|
maximum number of capturing subpatterns is 65535. |
130 |
|
</P> |
131 |
|
<P> |
132 |
|
There is no limit to the number of parenthesized subpatterns, but there can be |
133 |
|
no more than 65535 capturing subpatterns. |
134 |
</P> |
</P> |
135 |
<P> |
<P> |
136 |
All values in repeating quantifiers must be less than 65536. |
If a non-capturing subpattern with an unlimited repetition quantifier can match |
137 |
The maximum number of capturing subpatterns is 65535. |
an empty string, there is a limit of 1000 on the number of times it can be |
138 |
|
repeated while not matching an empty string - if it does match an empty |
139 |
|
string, the loop is immediately broken. |
140 |
</P> |
</P> |
141 |
<P> |
<P> |
142 |
There is no limit to the number of non-capturing subpatterns, but the maximum |
The maximum length of name for a named subpattern is 32 characters, and the |
143 |
depth of nesting of all kinds of parenthesized subpattern, including capturing |
maximum number of named subpatterns is 10000. |
|
subpatterns, assertions, and other types of subpattern, is 200. |
|
144 |
</P> |
</P> |
145 |
<P> |
<P> |
146 |
The maximum length of a subject string is the largest positive number that an |
The maximum length of a subject string is the largest positive number that an |
147 |
integer variable can hold. However, PCRE uses recursion to handle subpatterns |
integer variable can hold. However, when using the traditional matching |
148 |
and indefinite repetition. This means that the available stack space may limit |
function, PCRE uses recursion to handle subpatterns and indefinite repetition. |
149 |
the size of a subject string that can be processed by certain patterns. |
This means that the available stack space may limit the size of a subject |
150 |
|
string that can be processed by certain patterns. For a discussion of stack |
151 |
|
issues, see the |
152 |
|
<a href="pcrestack.html"><b>pcrestack</b></a> |
153 |
|
documentation. |
154 |
<a name="utf8support"></a></P> |
<a name="utf8support"></a></P> |
155 |
<br><a name="SEC4" href="#TOC1">UTF-8 AND UNICODE PROPERTY SUPPORT</a><br> |
<br><a name="SEC4" href="#TOC1">UTF-8 AND UNICODE PROPERTY SUPPORT</a><br> |
156 |
<P> |
<P> |
170 |
<P> |
<P> |
171 |
If you compile PCRE with UTF-8 support, but do not use it at run time, the |
If you compile PCRE with UTF-8 support, but do not use it at run time, the |
172 |
library will be a bit bigger, but the additional run time overhead is limited |
library will be a bit bigger, but the additional run time overhead is limited |
173 |
to testing the PCRE_UTF8 flag in several places, so should not be very large. |
to testing the PCRE_UTF8 flag occasionally, so should not be very big. |
174 |
</P> |
</P> |
175 |
<P> |
<P> |
176 |
If PCRE is built with Unicode character property support (which implies UTF-8 |
If PCRE is built with Unicode character property support (which implies UTF-8 |
177 |
support), the escape sequences \p{..}, \P{..}, and \X are supported. |
support), the escape sequences \p{..}, \P{..}, and \X are supported. |
178 |
The available properties that can be tested are limited to the general |
The available properties that can be tested are limited to the general |
179 |
category properties such as Lu for an upper case letter or Nd for a decimal |
category properties such as Lu for an upper case letter or Nd for a decimal |
180 |
number. A full list is given in the |
number, the Unicode script names such as Arabic or Han, and the derived |
181 |
|
properties Any and L&. A full list is given in the |
182 |
<a href="pcrepattern.html"><b>pcrepattern</b></a> |
<a href="pcrepattern.html"><b>pcrepattern</b></a> |
183 |
documentation. The PCRE library is increased in size by about 90K when Unicode |
documentation. Only the short names for properties are supported. For example, |
184 |
property support is included. |
\p{L} matches a letter. Its Perl synonym, \p{Letter}, is not supported. |
185 |
|
Furthermore, in Perl, many properties may optionally be prefixed by "Is", for |
186 |
|
compatibility with Perl 5.6. PCRE does not support this. |
187 |
</P> |
</P> |
188 |
<P> |
<P> |
189 |
The following comments apply when PCRE is running in UTF-8 mode: |
The following comments apply when PCRE is running in UTF-8 mode: |
201 |
may crash. |
may crash. |
202 |
</P> |
</P> |
203 |
<P> |
<P> |
204 |
2. In a pattern, the escape sequence \x{...}, where the contents of the braces |
2. An unbraced hexadecimal escape sequence (such as \xb3) matches a two-byte |
205 |
is a string of hexadecimal digits, is interpreted as a UTF-8 character whose |
UTF-8 character if the value is greater than 127. |
|
code number is the given hexadecimal number, for example: \x{1234}. If a |
|
|
non-hexadecimal digit appears between the braces, the item is not recognized. |
|
|
This escape sequence can be used either as a literal, or within a character |
|
|
class. |
|
206 |
</P> |
</P> |
207 |
<P> |
<P> |
208 |
3. The original hexadecimal escape sequence, \xhh, matches a two-byte UTF-8 |
3. Octal numbers up to \777 are recognized, and match two-byte UTF-8 |
209 |
character if the value is greater than 127. |
characters for values greater than \177. |
210 |
</P> |
</P> |
211 |
<P> |
<P> |
212 |
4. Repeat quantifiers apply to complete UTF-8 characters, not to individual |
4. Repeat quantifiers apply to complete UTF-8 characters, not to individual |
217 |
</P> |
</P> |
218 |
<P> |
<P> |
219 |
6. The escape sequence \C can be used to match a single byte in UTF-8 mode, |
6. The escape sequence \C can be used to match a single byte in UTF-8 mode, |
220 |
but its use can lead to some strange effects. |
but its use can lead to some strange effects. This facility is not available in |
221 |
|
the alternative matching function, <b>pcre_dfa_exec()</b>. |
222 |
</P> |
</P> |
223 |
<P> |
<P> |
224 |
7. The character escapes \b, \B, \d, \D, \s, \S, \w, and \W correctly |
7. The character escapes \b, \B, \d, \D, \s, \S, \w, and \W correctly |
234 |
low-valued characters. |
low-valued characters. |
235 |
</P> |
</P> |
236 |
<P> |
<P> |
237 |
9. Case-insensitive matching applies only to characters whose values are less |
9. However, the Perl 5.10 horizontal and vertical whitespace matching escapes |
238 |
|
(\h, \H, \v, and \V) do match all the appropriate Unicode characters. |
239 |
|
</P> |
240 |
|
<P> |
241 |
|
10. Case-insensitive matching applies only to characters whose values are less |
242 |
than 128, unless PCRE is built with Unicode property support. Even when Unicode |
than 128, unless PCRE is built with Unicode property support. Even when Unicode |
243 |
property support is available, PCRE still uses its own character tables when |
property support is available, PCRE still uses its own character tables when |
244 |
checking the case of low-valued characters, so as not to degrade performance. |
checking the case of low-valued characters, so as not to degrade performance. |
245 |
The Unicode property information is used only for characters with higher |
The Unicode property information is used only for characters with higher |
246 |
values. |
values. Even when Unicode property support is available, PCRE supports |
247 |
|
case-insensitive matching only when there is a one-to-one mapping between a |
248 |
|
letter's cases. There are a small number of many-to-one mappings in Unicode; |
249 |
|
these are not supported by PCRE. |
250 |
</P> |
</P> |
251 |
<br><a name="SEC5" href="#TOC1">AUTHOR</a><br> |
<br><a name="SEC5" href="#TOC1">AUTHOR</a><br> |
252 |
<P> |
<P> |
253 |
Philip Hazel <ph10@cam.ac.uk> |
Philip Hazel |
254 |
<br> |
<br> |
255 |
University Computing Service, |
University Computing Service |
256 |
<br> |
<br> |
257 |
Cambridge CB2 3QG, England. |
Cambridge CB2 3QH, England. |
258 |
|
<br> |
259 |
|
</P> |
260 |
|
<P> |
261 |
|
Putting an actual email address here seems to have been a spam magnet, so I've |
262 |
|
taken it away. If you want to email me, use my two initials, followed by the |
263 |
|
two digits 10, at the domain cam.ac.uk. |
264 |
|
</P> |
265 |
|
<br><a name="SEC6" href="#TOC1">REVISION</a><br> |
266 |
|
<P> |
267 |
|
Last updated: 30 July 2007 |
268 |
<br> |
<br> |
269 |
Phone: +44 1223 334714 |
Copyright © 1997-2007 University of Cambridge. |
|
Last updated: 09 September 2004 |
|
270 |
<br> |
<br> |
|
Copyright © 1997-2004 University of Cambridge. |
|
271 |
<p> |
<p> |
272 |
Return to the <a href="index.html">PCRE index page</a>. |
Return to the <a href="index.html">PCRE index page</a>. |
273 |
</p> |
</p> |