o ¹i;ã @s0UdZddlmZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddlZddlZddl mZmZmZmZmZddlmZddlZddlmZmZmZddlmZdgZd ZiZd ed<dd „Z dd„Z!dHdd„Z"ej#fdd„Z$dIdJdd„Z%Gdd„dƒZ&Gdd „d e&ƒZ'Gd!d"„d"e&ƒZ(Gd#d$„d$e(ƒZ)Gd%d&„d&e(ƒZ*Gd'd(„d(e(ƒZ+Gd)d*„d*e&ƒZ,Gd+d,„d,e(ƒZ-Gd-d.„d.e&ƒZ.e&ƒZ/d/d0„Z0dKd1d2„Z1d3d4„Z2dId5d6„Z3d7d8„Z4dId9d:„Z5dId;d<„Z6d=d>„Z7dKd?d@„Z8e0e1e2e3e5e7e8e4e6dAœ Z9dBdC„Z:GdDd„dƒZ;dEdF„Z -p [-D ] [-c ] [-i ] [-l ] [-s ] [-o ] [-f configfile] [--col ] [--prop ] <[-d ] [-C] [files...]" Reads csv files from stdin or given files if -d is given, use this delimiter if -s is given, skips N lines at the start Creates a URI from the columns given to -i, or automatically by numbering if none is given Outputs RDFS labels from the columns given to -l if -c is given adds a type triple with the given classname if -C is given, the class is defined as rdfs:Class Outputs one RDF triple per column in each row. Output is in n3 format. Output is stdout, unless -o is specified Long options also supported: --base, --propbase, --ident, --class, --label, --out, --defineclass Long options --col0, --col1, ... can be used to specify conversion for columns. Conversions can be: ignore, float(), int(), split(sep, [more]), uri(base, [class]), date(format) Long options --prop0, --prop1, ... can be used to use specific properties, rather than ones auto-generated from the headers -D sets the default conversion for columns not listed -f says to read config from a .ini/config file - the file must contain one section called csv2rdf, with keys like the long options, i.e.: [csv2rdf] out=output.n3 base=http://example.org/ col0=split(";") col1=split(";", uri("http://example.org/things/", "http://xmlns.com/foaf/0.1/Person")) col2=float() col3=int() col4=date("%Y-%b-%d %H:%M:%S") z*Dict[Any, Tuple[URIRef, Optional[URIRef]]]ÚuriscCsPt dd|¡}t dd|¡}| d¡}d |d ¡gdd„|d d …Dƒ¡S)zc CamelCase + lowercase initial a string FIRST_NM => firstNm firstNm => firstNm z[^\w]ú z([a-z])([A-Z])z\1 \2ÚrcSsg|]}| ¡‘qS©)Ú capitalize©Ú.0ÚxrrúO/var/www/edux/Edux_v2/venv/lib/python3.10/site-packages/rdflib/tools/csv2rdf.pyÚ móztoProperty..éN)ÚreÚsubÚsplitÚjoinÚlower©ÚlabelrrrÚ toProperty`s *r!cCs0|dd… ¡s|dd… ¡|dd…S|S)Nrér)ÚisupperrrrrrÚtoPropertyLabelpsr$Úl_ú List[int]ÚiúTuple[int, ...]Úreturncst‡fdd„|DƒƒS)zPreturn a set of indexes from a list >>> index([1,2,3],(0,2)) (1, 3) csg|]}ˆ|‘qSrrr©r%rrr{rzindex..)Útuple)r%r'rr*rÚindexvsr,cks,tj|fd|i|¤Ž}|D]}|VqdS)NÚdialect)ÚcsvÚreader)Úcsv_datar-ÚkwargsÚ csv_readerÚrowrrrr2~s €ÿr2Úclass_úOptional[URIRef]cCsD|rt |t| d¡ dd¡dd¡}nt |¡}||ft|<|S)NÚutf8rÚ_r©Úsafe)ÚrdflibrrÚencodeÚreplacer)rÚprefixr4ÚrrrrÚ prefixuri„s & r?c@seZdZdd„Zddd„ZdS) Ú NodeMakercCótjjS©N)r:r ÚLiteral©ÚselfrrrÚrange‘ózNodeMaker.rangerrcCs t |¡SrB)r:rC©rErrrrÚ__call__”ó zNodeMaker.__call__N)rr)Ú__name__Ú __module__Ú__qualname__rFrIrrrrr@sr@c@ó$eZdZdd„Zdd„Zdd„ZdS)ÚNodeUricCs$||_|r t |¡|_dSd|_dSrB)r=r:rr4)rEr=r4rrrÚ__init__™s zNodeUri.__init__cCst||j|jƒSrB)r?r=r4rHrrrrI ózNodeUri.__call__cCs|jptjjSrB)r4r:r ÚResourcerDrrrrF£sz NodeUri.rangeN©rKrLrMrPrIrFrrrrrO˜srOc@seZdZddd„ZdS)ÚNodeLiteralNcCs ||_dSrB©Úf)rErVrrrrP¨rJzNodeLiteral.__init__rB)rKrLrMrPrrrrrT§srTc@óeZdZdd„Zdd„ZdS)Ú NodeFloatcCó:|js t t|ƒ¡St|jƒrt t| |¡ƒ¡Stdƒ‚)Nz(Function passed to float is not callable)rVr:rCÚfloatÚcallableÚ ExceptionrHrrrrIó zNodeFloat.__call__cCrArB)r:ÚXSDÚdoublerDrrrrF´rGzNodeFloat.rangeN©rKrLrMrIrFrrrrrX¬órXc@rW)ÚNodeIntcCrY)Nz&Function passed to int is not callable)rVr:rCÚintr[r\rHrrrrI¹r]zNodeInt.__call__cCrArB)r:r^rcrDrrrrFÀrGz NodeInt.rangeNr`rrrrrb¸rarbc@rW)ÚNodeBoolcCrY)Nz'Function passed to bool is not callable)rVr:rCÚboolr[r\rHrrrrIÅr]zNodeBool.__call__cCrArB)r:r^rerDrrrrFÌrGzNodeBool.rangeNr`rrrrrdÄrardc@rW)ÚNodeReplacecCó||_||_dSrB©ÚaÚb)rErirjrrrrPÑó zNodeReplace.__init__cCs| |j|j¡SrB)r<rirjrHrrrrIÕrQzNodeReplace.__call__N)rKrLrMrPrIrrrrrfÐsrfc@rW)ÚNodeDatecCst tj ||j¡¡SrB)r:rCÚdatetimeÚstrptimerVrHrrrrIÚszNodeDate.__call__cCrArB)r:r^ÚdateTimerDrrrrFÝrGzNodeDate.rangeNr`rrrrrlÙsrlc@rN)Ú NodeSplitcCrgrB©ÚseprV)rErrrVrrrrPârkzNodeSplit.__init__cs:ˆjstjˆ_tˆjƒstdƒ‚‡fdd„| ˆj¡DƒS)Nz)Function passed to split is not callable!cs&g|]}| ¡dkrˆ | ¡¡‘qS)r)ÚstriprV)rÚyrDrrrës&z&NodeSplit.__call__..)rVr:rCr[r\rrrrHrrDrrIæs zNodeSplit.__call__cCs&|jrt|jtƒr|j ¡St |¡SrB)rVÚ isinstancer@rFrDrrrrFís zNodeSplit.rangeNrSrrrrrpásrpcOsdS)NÚignorer)Úargsr1rrrÚ_config_ignoreösrxcCó t||ƒSrB)rO)r=r4rrrÚ_config_uriúrJrzcCstƒSrB)rTrrrrÚ_config_literalþsr{cCót|ƒSrB)rXrUrrrÚ _config_floatrGr}cCryrB)rfrhrrrÚ_config_replacerJr~cCr|rB)rbrUrrrÚ_config_int rGrcCr|rB)rdrUrrrÚ_config_boolrGr€cCr|rB)rl)Úformat_rrrÚ_config_daterGr‚cCryrB)rprqrrrÚ _config_splitrJrƒ) rvÚuriÚliteralrZrcÚdaterr<recCs t|tƒS)z$Return a function for column mapping)ÚevalÚconfig_functions)ÚvrrrÚcolumn's rŠc@rN)r cCsTd|_d|_d|_d|_d|_d|_d|_d|_d|_i|_ i|_ tj|_ d|_dS)NÚautoFrú,)ÚCLASSÚBASEÚPROPBASEÚIDENTÚLABELÚDEFINECLASSÚSKIPÚDELIMÚDEFAULTÚCOLUMNSÚPROPSÚsysÚstdoutÚOUTÚtriplesrDrrrrP.s zCSV2RDF.__init__cCs4|j d| ¡| ¡| ¡f¡|jd7_dS)Nz%s %s %s . r)ršÚwriteÚn3r›)rEÚsÚpÚorrrÚtriple@s"zCSV2RDF.triplec s0t ¡}ˆjrtj dˆjj¡ˆjdkr!tˆjtƒs!ˆjfˆ_ˆj s/t d¡t d¡ˆ_ ˆjs=t d¡t d¡ˆ_tˆjƒD]}t|ƒqBtt|ƒƒ}tt‡fdd„|Dƒƒƒ}ˆj ¡D]\}}|||<t|ƒd ||<qaˆjrÓˆ ˆjtjtj¡tt|ƒƒD]M}||||} } | d ks˜| d kr™q…ˆj !|ˆj"¡dkr¤q…ˆ | tjtj#¡ˆ | tj$t %t&| ƒ¡¡ˆ | tj'ˆj¡ˆ | tjˆj !|t(¡ ¡¡q…d}|D]â} zÏˆjdkrçˆj d |}nˆj d )dd„t*| ˆjƒDƒ¡}ˆj+rˆ |tj$t %d )t*| ˆj+ƒ¡¡¡ˆjrˆ |tjˆj¡t| ƒD]l\}}| ,¡}|d krŠˆj !|ˆj"¡dkr9qz,ˆj !|tj%¡|ƒ} t| tƒrZ| D]}ˆ ||||¡qLn ˆ |||| ¡Wqt-y‰}zt dd|||||j.f¡WYd}~qd}~wwq|d 7}|ddkr§tj d|ˆj/t ¡|f¡Wq×t-y¹tj d|¡‚wt0ƒ}t1 ¡D])\} }|\}}ˆ |tj$t %| ¡¡|rét 2|¡}| 3|¡ˆ |tj|¡qÁ|D]}ˆ |tjtj¡qíˆj 4¡tj d|ˆj/f¡tj dt ¡|¡dS)Nz Output to %s r‹z2No base given, using http://example.org/instances/zhttp://example.org/instances/z:No property base given, using http://example.org/property/zhttp://example.org/props/csg|] }ˆjt|ƒ‘qSr)rr!rrDrrr[sz#CSV2RDF.convert..rrrvrz%dr7cSs&g|]}t| d¡ dd¡dd‘qS)r6rr7rr8)rr;r<rrrrrysÿÿrz#Could not process value for column z%d:%s in row %d, ignoring: %s i †z$%d rows, %d triples, elapsed %.2fs. zError processing line: %d z#Converted %d rows into %d triples. zTook %.2f seconds. )5Útimeršr˜ÚstderrrœÚnamerrur+rŽÚwarningsÚwarnr:Ú NamespacerrFr“ÚnextÚlistÚdictÚ enumerater—Úitemsrr’r¡rr Útyper ÚClassÚlenr–Úgetr•ÚPropertyr rCr$ÚdomainÚdefault_node_makerr,r‘rsr\Úmessager›ÚsetrrÚaddÚclose)rEÚ csvreaderÚstartrÚ header_labelsÚheadersÚkr‰r'Úhr%Úrowsr„r Ú_oÚeÚclassesÚuÚcrrDrÚconvertDsÈ ÿ þÿÿ ÿ ÿ€ÿÿÿ€ÿõÿÿ€þ € zCSV2RDF.convertN)rKrLrMrPr¡rÄrrrrr -scCstƒ}t tjdd…dgd¢¡\}}t|ƒ}d|vsd|vr(ttƒt d¡d|vrÑt ¡}| t|dƒ¡| d¡D]’\}}|d krOt |d d¡|_q>|dkrZt |¡|_q>|d kret |¡|_q>|dkrpt |¡|_q>|dkrzt|ƒ|_q>|dkr„t|ƒ|_q>|dkrŽt|ƒ|_q>|dkr–||_q>|dkr t|ƒ|_q>|dkrªt|ƒ|_q>| d¡r½t|ƒ|j t|dd…ƒ<q>| d¡rÐt |¡|j!t|dd…ƒ<q>d|vrßt |dd d¡|_d|vrít |dd d¡|_d|vrùt |d¡|_d|vrt |d¡|_d|vr|d|_d|vr|d|_d|vr&t|dƒ|_d |vr2t|d ƒ|_d!|vr?t |d!¡|_d"|vrLt |d"¡|_d#|vrXt|d#ƒ|_d$|vrdt|d$ƒ|_d%|vrpt|d%ƒ|_d&|vr|t|d&ƒ|_d'|vrˆt|d'ƒ|_d(|vr”t|d(ƒ|_d)|vr¡t |d)¡|_d*|vr®t |d*¡|_| ¡D].\}}| d+¡rËt|ƒ|j t|d,d…ƒ<q²| d-¡rßt |¡|j!t|d.d…ƒ<q²|jròd/|vsïd0|vròd1|_| "t#t$ %|¡|jd2¡dS)3Nrzhc:b:p:i:o:Cf:l:s:d:D:) zout=zbase=zdelim=z propbase=zclass=zdefault=ident=zlabel=zskip=ÚdefineclassÚhelpz-hz--helpéÿÿÿÿz-fÚcsv2rdfÚoutÚwzutf-8ÚbaseÚpropbaseÚclassrÅÚidentr ÚdelimÚskipÚdefaultÚcoléÚpropéz-oz--outz-bz--basez-dz--delimz-Dz --defaultz-pz --propbasez-lz--labelz-iz--identz-sz--skipz-cz--classz--coléz--propéz-Cz --defineclassT)Ú delimiter)&r Úgetoptr˜ÚargvrªÚprintÚHELPÚexitÚconfigparserÚConfigParserÚreadfpÚopenr¬Úcodecsršr:r§rŽrrrrer’r‡rr‘r”rcr“rŠr•Ú startswithr–r—rÄr2Ú fileinputÚinput)rÈÚoptsÚfilesÚconfigr¼r‰rrrÚmain¹s¨ý € €réÚ__main__)r%r&r'r(r)r(rB)r4r5)NN)>Ú__doc__Ú __future__rrârÞr.rmrärÙrr˜r¢r¥ÚtypingrrrrrÚurllib.parserr:Úrdflib.namespacer r rÚrdflib.termrÚ__all__rÜrÚ__annotations__r!r$r,Úexcelr2r?r@rOrTrXrbrdrfrlrpr³rxrzr{r}r~rr€r‚rƒrˆrŠr rérKrrrrÚsz? ÷ o ÿ