'[f%dZddlmZddlmZmZmZGddeZd dZGdd e Z Gd d eZ dS) zACorpus reader for the XML version of the British National Corpus.)concat) ElementTreeXMLCorpusReader XMLCorpusViewcHeZdZdZd dZd dZddZd dZdd Zdd Z d Z dS)BNCCorpusReadera7Corpus reader for the XML version of the British National Corpus. For access to the complete XML data structure, use the ``xml()`` method. For access to simple word lists and tagged word lists, use ``words()``, ``sents()``, ``tagged_words()``, and ``tagged_sents()``. You can obtain the full version of the BNC corpus at https://www.ota.ox.ac.uk/desc/2554 If you extracted the archive to a directory called `BNC`, then you can instantiate the reader as:: BNCCorpusReader(root='BNC/Texts/', fileids=r'[A-K]/\w*/\w*\.xml') Tc@tj|||||_dSN)r__init___lazy)selfrootfileidslazys J/var/www/piapp/venv/lib/python3.11/site-packages/nltk/corpus/reader/bnc.pyr zBNCCorpusReader.__init__s" tW555 NFc4||dd||S)aT :return: the given file(s) as a list of words and punctuation symbols. :rtype: list(str) :param strip_space: If true, then strip trailing spaces from word tokens. Otherwise, leave the spaces on the tokens. :param stem: If true, then use word stems instead of word strings. FN_viewsr r strip_spacestems rwordszBNCCorpusReader.words#s{{7E4dCCCrc@|rdnd}||d|||S)a  :return: the given file(s) as a list of tagged words and punctuation symbols, encoded as tuples ``(word,tag)``. :rtype: list(tuple(str,str)) :param c5: If true, then the tags used will be the more detailed c5 tags. Otherwise, the simplified tags will be used. :param strip_space: If true, then strip trailing spaces from word tokens. Otherwise, leave the spaces on the tokens. :param stem: If true, then use word stems instead of word strings. c5posFrr rrrrtags r tagged_wordszBNCCorpusReader.tagged_words/s,#dde{{7E3 TBBBrc4||dd||S)a :return: the given file(s) as a list of sentences or utterances, each encoded as a list of word strings. :rtype: list(list(str)) :param strip_space: If true, then strip trailing spaces from word tokens. Otherwise, leave the spaces on the tokens. :param stem: If true, then use word stems instead of word strings. TNrrs rsentszBNCCorpusReader.sents?s{{7D$ TBBBrcB|rdnd}||d|||S)a :return: the given file(s) as a list of sentences, each encoded as a list of ``(word,tag)`` tuples. :rtype: list(list(tuple(str,str))) :param c5: If true, then the tags used will be the more detailed c5 tags. Otherwise, the simplified tags will be used. :param strip_space: If true, then strip trailing spaces from word tokens. Otherwise, leave the spaces on the tokens. :param stem: If true, then use word stems instead of word strings. rrT)sentrrrrrs r tagged_sentszBNCCorpusReader.tagged_sentsLs8#dde{{ $C[t   rc|jrtn|jtfd||DS)zPA helper function that instantiates BNCWordViews or the list of words/sentences.c .g|]}|Sr').0fileidfr#rrrs r z*BNCCorpusReader._views..as;   &$[$77   r)r BNCWordView_wordsrabspaths)r rr#rrrr*s ````@rrzBNCCorpusReader._views]sq: 6KK4;        "mmG44      rc g}tj|}|dD]}g} t |D]} | j} | sd} |s|r| } |r| d| } |dkr| | df} n1|dkr+| | d| df} | | |r/|t|j d| | | d|vsJ|S)a Helper used to implement the view methods -- returns a list of words or a list of sentences, optionally tagged. :param fileid: The name of the underlying file. :param bracket_sent: If true, include sentence bracketing. :param tag: The name of the tagset to use, or None for no tags. :param strip_space: If true, strip spaces from word tokens. :param stem: If true, then substitute stems for words. z.//shwrrnN) rparsegetrootfindall_all_xmlwords_intextstripgetappend BNCSentenceattribextend) r r) bracket_sentrrrresultxmldocxmlsentr#xmlwordwords rr-zBNCCorpusReader._wordsgsc"6**2244~~f-- $ $GD+G44 " "|D($(::<pbgapaligneventpauseshiftvocalunclearcT|rd}nd}||_||_||_||_d|_d|_d|_d|_tj |||| | |j d|j |ddi|_dS)aG :param fileid: The name of the underlying file. :param sent: If true, include sentence bracketing. :param tag: The name of the tagset to use, or None for no tags. :param strip_space: If true, strip spaces from word tokens. :param stem: If true, then substitute stems for words. z.*/sz.*/s/(.*/)?(c|w)Nz .*/teiHeader$rr')_sent_tag _strip_space_stemtitleauthoreditorrespsrr _open read_block_stream handle_headerclose _tag_context)r r)r#rrrtagspecs rr zBNCWordView.__init__s  )GG(G  '     tVW555   ot7IJJJ Grc|d}|r$dd|D|_|d}|r$dd|D|_|d}|r$dd|D|_|d}|r&d d |D|_dSdS) NztitleStmt/title c3HK|]}|jVdSr r7r8)r(r`s r z,BNCWordView.handle_header..s0"J"J%5:#3#3#5#5"J"J"J"J"J"JrztitleStmt/authorc3HK|]}|jVdSr rn)r(ras rroz,BNCWordView.handle_header..0#N#NFFK$5$5$7$7#N#N#N#N#N#NrztitleStmt/editorc3HK|]}|jVdSr rn)r(rbs rroz,BNCWordView.handle_header..rqrztitleStmt/respStmtz c3TK|]#}dd|DV$dS)rlc3HK|]}|jVdSr rn)r(resp_elts rroz6BNCWordView.handle_header...s0EEH(---//EEEEEErN)join)r(resps rroz,BNCWordView.handle_header..sN%%JN EEEEEEE%%%%%%r)r5rvr`rarbrc)r rKcontexttitlesauthorseditorsrcs rrgzBNCWordView.handle_headers.//  K"J"J6"J"J"JJJDJ++011  O))#N#Ng#N#N#NNNDK++011  O))#N#Ng#N#N#NNNDK 011  %%RW%%%DJJJ  rcd|jr||S||Sr )r\ handle_sent handle_word)r rKrxs r handle_eltzBNCWordView.handle_elts4 : )##C(( (##C(( (rcL|j}|sd}|js|jr|}|jr|d|}|jdkr||df}n6|jdkr+||d|df}|S)Nr0r1rr)r7r^r_r8r9r])r rKrCs rr~zBNCWordView.handle_wordsx D     ::<.s'<<<))!,,<<rsHG******RRRRRRRRRR|||||o|||~#####$###f2f2f2f2f2-f2f2f2f2f2r