o i@sdZddlmZmZddlmZddlmZmZm Z m Z m Z ddl m Z ddlmZdgZ  dd e d ede edede ededd fddZd S)a( This file provides a single function `serialize_in_chunks()` which can serialize a Graph into a number of NT files with a maximum number of triples or maximum file size. There is an option to preserve any prefixes declared for the original graph in the first file, which will be a Turtle file. ) ExitStackcontextmanager)Path) TYPE_CHECKINGBinaryIO GeneratorOptionalTuple)Graph)_nt_rowserialize_in_chunks'NchunkFg max_triplesmax_file_size_kbfile_name_stem output_dirwrite_prefixesreturnc sHdurtstdtdtdttttfddfffdd }dt dt fdd }|rWt td d d d }| ||Wdn1sRwYd} t } |dur|d} |ridnd} t|dD]N\} }t|d }t|| krtd|d|dd|| dkr| || \}}d} n| t|| kr| d7} | || \}}d} | | |7} qrnOt|}||kr|jtdddn/|rdnd} t|dD]!\} }| |dkr| || \}}| d7} | t|d q WddSWddS1swYdS)ap Serializes a given Graph into a series of n-triples with a given length. :param g: The graph to serialize. :param max_file_size_kb: Maximum size per NT file in kB (1,000 bytes) Equivalent to ~6,000 triples, depending on Literal sizes. :param max_triples: Maximum size per NT file in triples Equivalent to lines in file. If both this parameter and max_file_size_kb are set, max_file_size_kb will be used. :param file_name_stem: Prefix of each file name. e.g. "chunk" = chunk_000001.nt, chunk_000002.nt... :param output_dir: The directory you want the files to be written to. :param write_prefixes: The first file created is a Turtle file containing original graph prefixes. See ``../test/test_tools/test_chunk_serializer.py`` for examples of this in use. Nz>If you specify an output_dir, it must actually be a directory!file_norc3sntr dus Jtdt|dd}t|d}||fVWddS1s0wYdS)N_z.ntwb)rrstrzfillopen)rfpfhrrX/var/www/edux/Edux_v2/venv/lib/python3.10/site-packages/rdflib/tools/chunk_serializer.py_start_new_fileFs "  "z,serialize_in_chunks.._start_new_filercSsBg}|jD]\}}|d|d|dqdt|dS)NzPREFIX z: <> )namespace_manager namespacesappendjoinsorted)rpreskvr r r!_serialize_prefixesOsz0serialize_in_chunks.._serialize_prefixesz _000000.ttlwzutf-8)encodingri)NNNzcannot write triple z as it's serialized size of z exceeds max_file_size_kb = z_all.ntnt) destinationformat)rcwdis_dir ValueErrorrintrr rr rrwriter enumeratetriplesr encodelen enter_context serialize)rrrrrrr"r-r bytes_writtenxstack max_file_sizerit row_bytesrfhb graph_lengthr rr!r sh&,    $)r NrNF)__doc__ contextlibrrpathlibrtypingrrrrr rdflib.graphr rdflib.plugins.serializers.ntr __all__r7rboolr r r r r!s6