Class LineSplitter

All Implemented Interfaces:

Splitter<StringHandle>

• Nested Class Summary

  Nested Classes
  Modifier and Type

  Class

  Description

  static interface 

  LineSplitter.UriMaker

  UriMaker which generates URI for each split file

• Constructor Summary

  Constructors
  Constructor

  Description

  LineSplitter()

   

• Method Summary

  All MethodsInstance MethodsConcrete Methods

  Modifier and Type

  Method

  Description

  long

  getCount()

  Used to return the number of objects in the stream.

  Format

  getFormat()

  Returns the document format set to splitter.

  LineSplitter.UriMaker

  getUriMaker()

  Get the UriMaker of the splitter

  void

  setFormat(Format format)

  Used to set document format to splitter.

  void

  setUriMaker(LineSplitter.UriMaker uriMaker)

  Set the UriMaker to the splitter

  Stream<StringHandle>

  split(InputStream input)

  Takes the input stream and converts it into a stream of StringHandle.

  Stream<StringHandle>

  split(InputStream input, Charset charset)

  Takes the input stream and converts it into a stream of StringHandle.

  Stream<StringHandle>

  split(Reader input)

  Takes the Reader input and converts it into a stream of StringHandle.

  Stream<DocumentWriteOperation>

  splitWriteOperations(InputStream input)

  Takes the input stream and converts it into a stream of DocumentWriteOperation.

  Stream<DocumentWriteOperation>

  splitWriteOperations(InputStream input, String splitFilename)

  Takes the input stream and input file name and converts it into a stream of DocumentWriteOperation.

  Methods inherited from class java.lang.Object

  clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

• Constructor Details

  • LineSplitter

    public LineSplitter()

• Method Details

  • getFormat

    public Format getFormat()
    Returns the document format set to splitter.

    Returns:

    the document format set to splitter. The default is Format.JSON.

  • setFormat

    public void setFormat(Format format)
    Used to set document format to splitter. The extension of URLs generated for splits is determined by this format. The format should be set before splitting. If not set, the default is JSON.

    Parameters:

    format - the document content format.

  • getCount

    public long getCount()
    Used to return the number of objects in the stream.

    Specified by:

    getCount in interface Splitter<StringHandle>

    Returns:

    the number of objects in the stream.

  • split

    public Stream<StringHandle> split(InputStream input) throws IOException
    Takes the input stream and converts it into a stream of StringHandle. The content could be line-delimited JSON, XML or TEXT file. It could also be gzip-compressed line-delimited files. Provide GZIPInputStream to the splitter when splitting gzip files.

    Specified by:

    split in interface Splitter<StringHandle>

    Parameters:

    input - is the incoming input stream.

    Returns:

    a stream of StringHandle.

    Throws:

    IOException - if the input cannot be split

  • splitWriteOperations

    public Stream<DocumentWriteOperation> splitWriteOperations(InputStream input) throws Exception
    Takes the input stream and converts it into a stream of DocumentWriteOperation. The content could be line-delimited JSON, XML or TEXT file. It could also be gzip-compressed line-delimited files. Provide GZIPInputStream to the splitter when splitting gzip files.

    Specified by:

    splitWriteOperations in interface Splitter<StringHandle>

    Parameters:

    input - is the incoming input stream.

    Returns:

    a stream of DocumentWriteOperation.

    Throws:

    Exception - if the input cannot be split

  • splitWriteOperations

    public Stream<DocumentWriteOperation> splitWriteOperations(InputStream input, String splitFilename) throws Exception
    Takes the input stream and input file name and converts it into a stream of DocumentWriteOperation. The content could be line-delimited JSON, XML or TEXT file. It could also be gzip-compressed line-delimited files. Provide GZIPInputStream to the splitter when splitting gzip files.

    Specified by:

    splitWriteOperations in interface Splitter<StringHandle>

    Parameters:

    input - is the incoming input stream.

    splitFilename - is the name of the input file, including name and extension. It is used to generate URLs for split files. The splitFilename could either be provided here or in user-defined UriMaker.

    Returns:

    a stream of DocumentWriteOperation.

    Throws:

    Exception - if the input cannot be split

  • split

    public Stream<StringHandle> split(InputStream input, Charset charset) throws IOException
    Takes the input stream and converts it into a stream of StringHandle. The content could be line-delimited JSON file, line-delimited XML file or gzip-compressed line-delimited JSON file.

    Parameters:

    input - is the incoming input stream.

    charset - is the encoding scheme the document uses.

    Returns:

    a stream of StringHandle.

    Throws:

    IOException - if the input cannot be split

  • split

    public Stream<StringHandle> split(Reader input) throws IOException
    Takes the Reader input and converts it into a stream of StringHandle. The content could be line-delimited JSON file, line-delimited XML file or gzip-compressed line-delimited JSON file.

    Parameters:

    input - is the incoming Reader.

    Returns:

    a stream of StringHandle.

    Throws:

    IOException - if the input cannot be split

  • getUriMaker

    public LineSplitter.UriMaker getUriMaker()
    Get the UriMaker of the splitter

    Returns:

    the UriMaker of the splitter

  • setUriMaker

    public void setUriMaker(LineSplitter.UriMaker uriMaker)
    Set the UriMaker to the splitter

    Parameters:

    uriMaker - the uriMaker to generate URI of each split file.

Copyright (c) 2010-2025 Progress Software Corporation and/or its subsidiaries or affiliates. All Rights Reserved.