/[pcre]/code/trunk/doc/pcretest.txt
ViewVC logotype

Diff of /code/trunk/doc/pcretest.txt

Parent Directory Parent Directory | Revision Log Revision Log | View Patch Patch

revision 79 by nigel, Sat Feb 24 21:40:52 2007 UTC revision 96 by nigel, Fri Mar 2 13:10:43 2007 UTC
# Line 7  NAME Line 7  NAME
7    
8  SYNOPSIS  SYNOPSIS
9    
10         pcretest [-C] [-d] [-dfa] [-i] [-m] [-o osize] [-p] [-t] [source]         pcretest [options] [source] [destination]
             [destination]  
11    
12         pcretest  was written as a test program for the PCRE regular expression         pcretest  was written as a test program for the PCRE regular expression
13         library itself, but it can also be used for experimenting with  regular         library itself, but it can also be used for experimenting with  regular
# Line 20  SYNOPSIS Line 19  SYNOPSIS
19    
20  OPTIONS  OPTIONS
21    
22           -b        Behave as if each regex has the /B (show bytecode)  modifier;
23                     the internal form is output after compilation.
24    
25         -C        Output the version number of the PCRE library, and all avail-         -C        Output the version number of the PCRE library, and all avail-
26                   able   information  about  the  optional  features  that  are                   able  information  about  the  optional  features  that   are
27                   included, and then exit.                   included, and then exit.
28    
29         -d        Behave as if each regex has  the  /D  (debug)  modifier;  the         -d        Behave  as  if  each  regex  has the /D (debug) modifier; the
30                   internal form is output after compilation.                   internal form and information about the compiled  pattern  is
31                     output after compilation; -d is equivalent to -b -i.
32    
33         -dfa      Behave  as if each data line contains the \D escape sequence;         -dfa      Behave  as if each data line contains the \D escape sequence;
34                   this    causes    the    alternative    matching    function,                   this    causes    the    alternative    matching    function,
35                   pcre_dfa_exec(),   to   be   used  instead  of  the  standard                   pcre_dfa_exec(),   to   be   used  instead  of  the  standard
36                   pcre_exec() function (more detail is given below).                   pcre_exec() function (more detail is given below).
37    
38           -help     Output a brief summary these options and then exit.
39    
40         -i        Behave as if each regex  has  the  /I  modifier;  information         -i        Behave as if each regex  has  the  /I  modifier;  information
41                   about the compiled pattern is given after compilation.                   about the compiled pattern is given after compilation.
42    
# Line 41  OPTIONS Line 46  OPTIONS
46                   pcretest, -s is a synonym for -m.                   pcretest, -s is a synonym for -m.
47    
48         -o osize  Set the number of elements in the output vector that is  used         -o osize  Set the number of elements in the output vector that is  used
49                   when  calling  pcre_exec()  to be osize. The default value is                   when  calling pcre_exec() or pcre_dfa_exec() to be osize. The
50                   45, which is enough for 14 capturing subexpressions. The vec-                   default value is 45, which is enough for 14 capturing  subex-
51                   tor  size  can  be  changed  for individual matching calls by                   pressions   for  pcre_exec()  or  22  different  matches  for
52                   including \O in the data line (see below).                   pcre_dfa_exec(). The vector size can be changed for  individ-
53                     ual  matching  calls  by  including  \O in the data line (see
54                     below).
55    
56         -p        Behave as if each regex has the /P modifier; the POSIX  wrap-         -p        Behave as if each regex has the /P modifier; the POSIX  wrap-
57                   per  API  is used to call PCRE. None of the other options has                   per  API  is used to call PCRE. None of the other options has
58                   any effect when -p is set.                   any effect when -p is set.
59    
60           -q        Do not output the version number of pcretest at the start  of
61                     execution.
62    
63           -S size   On  Unix-like  systems,  set the size of the runtime stack to
64                     size megabytes.
65    
66         -t        Run each compile, study, and match many times with  a  timer,         -t        Run each compile, study, and match many times with  a  timer,
67                   and  output resulting time per compile or match (in millisec-                   and  output resulting time per compile or match (in millisec-
68                   onds). Do not set -m with -t, because you will then  get  the                   onds). Do not set -m with -t, because you will then  get  the
69                   size  output  a  zillion  times,  and the timing will be dis-                   size  output  a  zillion  times,  and the timing will be dis-
70                   torted.                   torted. You can control the number  of  iterations  that  are
71                     used  for timing by following -t with a number (as a separate
72                     item on the command line). For example, "-t 1000" would iter-
73                     ate 1000 times. The default is to iterate 500000 times.
74    
75           -tm       This is like -t except that it times only the matching phase,
76                     not the compile or study phases.
77    
78    
79  DESCRIPTION  DESCRIPTION
# Line 71  DESCRIPTION Line 90  DESCRIPTION
90         ber of data lines to be matched against the pattern.         ber of data lines to be matched against the pattern.
91    
92         Each  data line is matched separately and independently. If you want to         Each  data line is matched separately and independently. If you want to
93         do multiple-line matches, you have to use the \n escape sequence  in  a         do multi-line matches, you have to use the \n escape sequence (or \r or
94         single  line  of  input  to  encode the newline characters. The maximum         \r\n, etc., depending on the newline setting) in a single line of input
95         length of data line is 30,000 characters.         to encode the newline sequences. There is no limit  on  the  length  of
96           data  lines;  the  input  buffer is automatically extended if it is too
97           small.
98    
99         An empty line signals the end of the data lines, at which point  a  new         An empty line signals the end of the data lines, at which point  a  new
100         regular  expression is read. The regular expressions are given enclosed         regular  expression is read. The regular expressions are given enclosed
101         in any non-alphanumeric delimiters other than backslash, for example         in any non-alphanumeric delimiters other than backslash, for example:
102    
103           /(a|bc)x+yz/           /(a|bc)x+yz/
104    
# Line 125  PATTERN MODIFIERS Line 146  PATTERN MODIFIERS
146         The following table shows additional modifiers for setting PCRE options         The following table shows additional modifiers for setting PCRE options
147         that do not correspond to anything in Perl:         that do not correspond to anything in Perl:
148    
149           /A    PCRE_ANCHORED           /A       PCRE_ANCHORED
150           /C    PCRE_AUTO_CALLOUT           /C       PCRE_AUTO_CALLOUT
151           /E    PCRE_DOLLAR_ENDONLY           /E       PCRE_DOLLAR_ENDONLY
152           /f    PCRE_FIRSTLINE           /f       PCRE_FIRSTLINE
153           /N    PCRE_NO_AUTO_CAPTURE           /J       PCRE_DUPNAMES
154           /U    PCRE_UNGREEDY           /N       PCRE_NO_AUTO_CAPTURE
155           /X    PCRE_EXTRA           /U       PCRE_UNGREEDY
156             /X       PCRE_EXTRA
157             /<cr>    PCRE_NEWLINE_CR
158             /<lf>    PCRE_NEWLINE_LF
159             /<crlf>  PCRE_NEWLINE_CRLF
160             /<any>   PCRE_NEWLINE_ANY
161    
162           Those  specifying  line ending sequencess are literal strings as shown.
163           This example sets multiline matching  with  CRLF  as  the  line  ending
164           sequence:
165    
166             /^abc/m<crlf>
167    
168           Details  of the meanings of these PCRE options are given in the pcreapi
169           documentation.
170    
171       Finding all matches in a string
172    
173         Searching  for  all  possible matches within each subject string can be         Searching for all possible matches within each subject  string  can  be
174         requested by the /g or /G modifier. After  finding  a  match,  PCRE  is         requested  by  the  /g  or  /G modifier. After finding a match, PCRE is
175         called again to search the remainder of the subject string. The differ-         called again to search the remainder of the subject string. The differ-
176         ence between /g and /G is that the former uses the startoffset argument         ence between /g and /G is that the former uses the startoffset argument
177         to  pcre_exec()  to  start  searching  at a new point within the entire         to pcre_exec() to start searching at a  new  point  within  the  entire
178         string (which is in effect what Perl does), whereas the  latter  passes         string  (which  is in effect what Perl does), whereas the latter passes
179         over  a  shortened  substring.  This makes a difference to the matching         over a shortened substring. This makes a  difference  to  the  matching
180         process if the pattern begins with a lookbehind assertion (including \b         process if the pattern begins with a lookbehind assertion (including \b
181         or \B).         or \B).
182    
183         If  any  call  to  pcre_exec()  in a /g or /G sequence matches an empty         If any call to pcre_exec() in a /g or  /G  sequence  matches  an  empty
184         string, the next call is done with the PCRE_NOTEMPTY and  PCRE_ANCHORED         string,  the next call is done with the PCRE_NOTEMPTY and PCRE_ANCHORED
185         flags  set in order to search for another, non-empty, match at the same         flags set in order to search for another, non-empty, match at the  same
186         point.  If this second match fails, the start  offset  is  advanced  by         point.   If  this  second  match fails, the start offset is advanced by
187         one,  and  the normal match is retried. This imitates the way Perl han-         one, and the normal match is retried. This imitates the way  Perl  han-
188         dles such cases when using the /g modifier or the split() function.         dles such cases when using the /g modifier or the split() function.
189    
190       Other modifiers
191    
192         There are yet more modifiers for controlling the way pcretest operates.         There are yet more modifiers for controlling the way pcretest operates.
193    
194         The  /+ modifier requests that as well as outputting the substring that         The /+ modifier requests that as well as outputting the substring  that
195         matched the entire pattern, pcretest  should  in  addition  output  the         matched  the  entire  pattern,  pcretest  should in addition output the
196         remainder  of  the  subject  string. This is useful for tests where the         remainder of the subject string. This is useful  for  tests  where  the
197         subject contains multiple copies of the same substring.         subject contains multiple copies of the same substring.
198    
199           The  /B modifier is a debugging feature. It requests that pcretest out-
200           put a representation of the compiled byte code after compilation.
201    
202         The /L modifier must be followed directly by the name of a locale,  for         The /L modifier must be followed directly by the name of a locale,  for
203         example,         example,
204    
# Line 175  PATTERN MODIFIERS Line 217  PATTERN MODIFIERS
217         pattern.  If  the pattern is studied, the results of that are also out-         pattern.  If  the pattern is studied, the results of that are also out-
218         put.         put.
219    
220         The /D modifier is a PCRE debugging feature, which also assumes /I.  It         The /D modifier is a PCRE debugging feature, and is equivalent to  /BI,
221         causes  the  internal form of compiled regular expressions to be output         that is, both the /B and the /I modifiers.
        after compilation. If the pattern was studied, the information returned  
        is also output.  
222    
223         The /F modifier causes pcretest to flip the byte order of the fields in         The /F modifier causes pcretest to flip the byte order of the fields in
224         the compiled pattern that  contain  2-byte  and  4-byte  numbers.  This         the compiled pattern that  contain  2-byte  and  4-byte  numbers.  This
# Line 220  DATA LINES Line 260  DATA LINES
260         nary"  regular  expressions,  you probably don't need any of these. The         nary"  regular  expressions,  you probably don't need any of these. The
261         following escapes are recognized:         following escapes are recognized:
262    
263           \a         alarm (= BEL)           \a         alarm (BEL, \x07)
264           \b         backspace           \b         backspace (\x08)
265           \e         escape           \e         escape (\x27)
266           \f         formfeed           \f         formfeed (\x0c)
267           \n         newline           \n         newline (\x0a)
268           \r         carriage return           \qdd       set the PCRE_MATCH_LIMIT limit to dd
269           \t         tab                        (any number of digits)
270           \v         vertical tab           \r         carriage return (\x0d)
271             \t         tab (\x09)
272             \v         vertical tab (\x0b)
273           \nnn       octal character (up to 3 octal digits)           \nnn       octal character (up to 3 octal digits)
274           \xhh       hexadecimal character (up to 2 hex digits)           \xhh       hexadecimal character (up to 2 hex digits)
275           \x{hh...}  hexadecimal character, any number of digits           \x{hh...}  hexadecimal character, any number of digits
276                        in UTF-8 mode                        in UTF-8 mode
277           \A         pass the PCRE_ANCHORED option to pcre_exec()           \A         pass the PCRE_ANCHORED option to pcre_exec()
278                          or pcre_dfa_exec()
279           \B         pass the PCRE_NOTBOL option to pcre_exec()           \B         pass the PCRE_NOTBOL option to pcre_exec()
280                          or pcre_dfa_exec()
281           \Cdd       call pcre_copy_substring() for substring dd           \Cdd       call pcre_copy_substring() for substring dd
282                        after a successful match (number less than 32)                        after a successful match (number less than 32)
283           \Cname     call pcre_copy_named_substring() for substring           \Cname     call pcre_copy_named_substring() for substring
# Line 257  DATA LINES Line 301  DATA LINES
301                        ated by next non-alphanumeric character)                        ated by next non-alphanumeric character)
302           \L         call pcre_get_substringlist() after a           \L         call pcre_get_substringlist() after a
303                        successful match                        successful match
304           \M         discover the minimum MATCH_LIMIT setting           \M         discover the minimum MATCH_LIMIT and
305                          MATCH_LIMIT_RECURSION settings
306           \N         pass the PCRE_NOTEMPTY option to pcre_exec()           \N         pass the PCRE_NOTEMPTY option to pcre_exec()
307                          or pcre_dfa_exec()
308           \Odd       set the size of the output vector passed to           \Odd       set the size of the output vector passed to
309                        pcre_exec() to dd (any number of digits)                        pcre_exec() to dd (any number of digits)
310           \P         pass the PCRE_PARTIAL option to pcre_exec()           \P         pass the PCRE_PARTIAL option to pcre_exec()
311                        or pcre_dfa_exec()                        or pcre_dfa_exec()
312             \Qdd       set the PCRE_MATCH_LIMIT_RECURSION limit to dd
313                          (any number of digits)
314           \R         pass the PCRE_DFA_RESTART option to pcre_dfa_exec()           \R         pass the PCRE_DFA_RESTART option to pcre_dfa_exec()
315           \S         output details of memory get/free calls during matching           \S         output details of memory get/free calls during matching
316           \Z         pass the PCRE_NOTEOL option to pcre_exec()           \Z         pass the PCRE_NOTEOL option to pcre_exec()
317                          or pcre_dfa_exec()
318           \?         pass the PCRE_NO_UTF8_CHECK option to           \?         pass the PCRE_NO_UTF8_CHECK option to
319                        pcre_exec()                        pcre_exec() or pcre_dfa_exec()
320           \>dd       start the match at offset dd (any number of digits);           \>dd       start the match at offset dd (any number of digits);
321                        this sets the startoffset argument for pcre_exec()                        this sets the startoffset argument for pcre_exec()
322                          or pcre_dfa_exec()
323             \<cr>      pass the PCRE_NEWLINE_CR option to pcre_exec()
324                          or pcre_dfa_exec()
325             \<lf>      pass the PCRE_NEWLINE_LF option to pcre_exec()
326                          or pcre_dfa_exec()
327             \<crlf>    pass the PCRE_NEWLINE_CRLF option to pcre_exec()
328                          or pcre_dfa_exec()
329             \<any>     pass the PCRE_NEWLINE_ANY option to pcre_exec()
330                          or pcre_dfa_exec()
331    
332           The escapes that specify line ending  sequences  are  literal  strings,
333           exactly as shown. No more than one newline setting should be present in
334           any data line.
335    
336         A backslash followed by anything else just escapes the  anything  else.         A backslash followed by anything else just escapes the  anything  else.
337         If  the very last character is a backslash, it is ignored. This gives a         If  the very last character is a backslash, it is ignored. This gives a
# Line 277  DATA LINES Line 339  DATA LINES
339         nates the data input.         nates the data input.
340    
341         If  \M  is present, pcretest calls pcre_exec() several times, with dif-         If  \M  is present, pcretest calls pcre_exec() several times, with dif-
342         ferent values in the match_limit field of the  pcre_extra  data  struc-         ferent values in the match_limit and  match_limit_recursion  fields  of
343         ture,  until it finds the minimum number that is needed for pcre_exec()         the  pcre_extra  data structure, until it finds the minimum numbers for
344         to complete. This number is a measure of the amount  of  recursion  and         each parameter that allow pcre_exec() to complete. The match_limit num-
345         backtracking  that takes place, and checking it out can be instructive.         ber  is  a  measure of the amount of backtracking that takes place, and
346         For most simple matches, the number is quite small,  but  for  patterns         checking it out can be instructive. For most simple matches, the number
347         with  very large numbers of matching possibilities, it can become large         is  quite  small,  but for patterns with very large numbers of matching
348         very quickly with increasing length of subject string.         possibilities, it can become large very quickly with increasing  length
349           of subject string. The match_limit_recursion number is a measure of how
350           much stack (or, if PCRE is compiled with  NO_RECURSE,  how  much  heap)
351           memory is needed to complete the match attempt.
352    
353         When \O is used, the value specified may be higher or  lower  than  the         When  \O  is  used, the value specified may be higher or lower than the
354         size set by the -O command line option (or defaulted to 45); \O applies         size set by the -O command line option (or defaulted to 45); \O applies
355         only to the call of pcre_exec() for the line in which it appears.         only to the call of pcre_exec() for the line in which it appears.
356    
357         If the /P modifier was present on the pattern, causing the POSIX  wrap-         If  the /P modifier was present on the pattern, causing the POSIX wrap-
358         per  API to be used, only \B and \Z have any effect, causing REG_NOTBOL         per API to be used, the only option-setting  sequences  that  have  any
359         and REG_NOTEOL to be passed to regexec() respectively.         effect  are \B and \Z, causing REG_NOTBOL and REG_NOTEOL, respectively,
360           to be passed to regexec().
361    
362         The use of \x{hh...} to represent UTF-8 characters is not dependent  on         The use of \x{hh...} to represent UTF-8 characters is not dependent  on
363         the  use  of  the  /8 modifier on the pattern. It is recognized always.         the  use  of  the  /8 modifier on the pattern. It is recognized always.
# Line 327  DEFAULT OUTPUT FROM PCRETEST Line 393  DEFAULT OUTPUT FROM PCRETEST
393         is an example of an interactive pcretest run.         is an example of an interactive pcretest run.
394    
395           $ pcretest           $ pcretest
396           PCRE version 5.00 07-Sep-2004           PCRE version 7.0 30-Nov-2006
397    
398             re> /^abc(\d+)/             re> /^abc(\d+)/
399           data> abc123           data> abc123
# Line 338  DEFAULT OUTPUT FROM PCRETEST Line 404  DEFAULT OUTPUT FROM PCRETEST
404    
405         If the strings contain any non-printing characters, they are output  as         If the strings contain any non-printing characters, they are output  as
406         \0x  escapes,  or  as \x{...} escapes if the /8 modifier was present on         \0x  escapes,  or  as \x{...} escapes if the /8 modifier was present on
407         the pattern. If the pattern has the /+ modifier, the  output  for  sub-         the pattern. See below for the definition of  non-printing  characters.
408         string  0 is followed by the the rest of the subject string, identified         If  the pattern has the /+ modifier, the output for substring 0 is fol-
409         by "0+" like this:         lowed by the the rest of the subject string, identified  by  "0+"  like
410           this:
411    
412             re> /cat/+             re> /cat/+
413           data> cataract           data> cataract
414            0: cat            0: cat
415            0+ aract            0+ aract
416    
417         If the pattern has the /g or /G modifier,  the  results  of  successive         If  the  pattern  has  the /g or /G modifier, the results of successive
418         matching attempts are output in sequence, like this:         matching attempts are output in sequence, like this:
419    
420             re> /\Bi(\w\w)/g             re> /\Bi(\w\w)/g
# Line 361  DEFAULT OUTPUT FROM PCRETEST Line 428  DEFAULT OUTPUT FROM PCRETEST
428    
429         "No match" is output only if the first match attempt fails.         "No match" is output only if the first match attempt fails.
430    
431         If  any  of the sequences \C, \G, or \L are present in a data line that         If any of the sequences \C, \G, or \L are present in a data  line  that
432         is successfully matched, the substrings extracted  by  the  convenience         is  successfully  matched,  the substrings extracted by the convenience
433         functions are output with C, G, or L after the string number instead of         functions are output with C, G, or L after the string number instead of
434         a colon. This is in addition to the normal full list. The string length         a colon. This is in addition to the normal full list. The string length
435         (that  is,  the return from the extraction function) is given in paren-         (that is, the return from the extraction function) is given  in  paren-
436         theses after each string for \C and \G.         theses after each string for \C and \G.
437    
438         Note that while patterns can be continued over several lines  (a  plain         Note that whereas patterns can be continued over several lines (a plain
439         ">" prompt is used for continuations), data lines may not. However new-         ">" prompt is used for continuations), data lines may not. However new-
440         lines can be included in data by means of the \n escape.         lines  can  be included in data by means of the \n escape (or \r, \r\n,
441           etc., depending on the newline sequence setting).
442    
443    
444  OUTPUT FROM THE ALTERNATIVE MATCHING FUNCTION  OUTPUT FROM THE ALTERNATIVE MATCHING FUNCTION
# Line 389  OUTPUT FROM THE ALTERNATIVE MATCHING FUN Line 457  OUTPUT FROM THE ALTERNATIVE MATCHING FUN
457         (Using  the  normal  matching function on this data finds only "tang".)         (Using  the  normal  matching function on this data finds only "tang".)
458         The longest matching string is always given first (and numbered  zero).         The longest matching string is always given first (and numbered  zero).
459    
460         If  /gP  is  present  on  the  pattern,  the search for further matches         If /g is present on the pattern, the search for further matches resumes
461         resumes at the end of the longest match. For example:         at the end of the longest match. For example:
462    
463             re> /(tang|tangerine|tan)/g             re> /(tang|tangerine|tan)/g
464           data> yellow tangerine and tangy sultana\D           data> yellow tangerine and tangy sultana\D
# Line 463  CALLOUTS Line 531  CALLOUTS
531         the pcrecallout documentation.         the pcrecallout documentation.
532    
533    
534    NON-PRINTING CHARACTERS
535    
536           When  pcretest is outputting text in the compiled version of a pattern,
537           bytes other than 32-126 are always treated as  non-printing  characters
538           are are therefore shown as hex escapes.
539    
540           When  pcretest  is  outputting text that is a matched part of a subject
541           string, it behaves in the same way, unless a different locale has  been
542           set  for  the  pattern  (using  the  /L  modifier).  In  this case, the
543           isprint() function to distinguish printing and non-printing characters.
544    
545    
546  SAVING AND RELOADING COMPILED PATTERNS  SAVING AND RELOADING COMPILED PATTERNS
547    
548         The  facilities  described  in  this section are not available when the         The  facilities  described  in  this section are not available when the
# Line 519  SAVING AND RELOADING COMPILED PATTERNS Line 599  SAVING AND RELOADING COMPILED PATTERNS
599         a file that is not in the correct format, the result is undefined.         a file that is not in the correct format, the result is undefined.
600    
601    
602    SEE ALSO
603    
604           pcre(3), pcreapi(3), pcrecallout(3),  pcrematching(3),  pcrepartial(d),
605           pcrepattern(3), pcreprecompile(3).
606    
607    
608  AUTHOR  AUTHOR
609    
610         Philip Hazel         Philip Hazel
611         University Computing Service,         University Computing Service,
612         Cambridge CB2 3QG, England.         Cambridge CB2 3QH, England.
613    
614  Last updated: 28 February 2005  Last updated: 30 November 2006
615  Copyright (c) 1997-2005 University of Cambridge.  Copyright (c) 1997-2006 University of Cambridge.

Legend:
Removed from v.79  
changed lines
  Added in v.96

  ViewVC Help
Powered by ViewVC 1.1.5