Documentation for SparkNLP Readers and Partition class #14581
Conversation
… feature/SPARKNLP-1174-Adding-PartitionTransformer-documentation
… feature/SPARKNLP-1174-Adding-PartitionTransformer-documentation
…ttps://github.com/JohnSnowLabs/spark-nlp into feature/SPARKNLP-1174-Adding-PartitionTransformer
… feature/SPARKNLP-1174-Adding-PartitionTransformer-documentation
There was a problem hiding this comment.
I commented on a minor link thing affecting
src/main/scala/com/johnsnowlabs/reader/ExcelReader.scala
src/main/scala/com/johnsnowlabs/reader/HTMLReader.scala
src/main/scala/com/johnsnowlabs/reader/PowerPointReader.scala
src/main/scala/com/johnsnowlabs/reader/TextReader.scala
src/main/scala/com/johnsnowlabs/reader/WordReader.scala
src/main/scala/com/johnsnowlabs/partition/Partition.scala
Other than that, looks good to me. Thanks!
@danilojsl if this looks good to you, we can merge it into your branch!
src/main/scala/com/johnsnowlabs/partition/PartitionTransformer.scala
Outdated
Show resolved
Hide resolved
LGFM I merged it |
* Update conda meta.yaml for 6.0.1 [skip test] * added documentation to file readers * updated docs for partition class in scala and python * fixed typos in sparkNLPReader and added documentation for Partition class * added parameters to Partition class and updated read function docs in Readers * updated readers documentation with ipynb path * updated partition description * fixed errors in email readers * fixed errors in email readers * added docs for partition transformer and pdf reader * added docs for python partition transformer and pdf reader * added docs for python partition transformer and pdf reader * updated docs to render partition and reader * reverted changes in init.py * reverted changes in imports * updated formatting docs for pdf reader * updated formatting of docs for spark nlp reader * updated formatting of docs for partition * updated formatting of docs for partition_transformer * updating links to notebooks and partition transformer description --------- Co-authored-by: Devin Ha <[email protected]> Co-authored-by: Paulami Bhattacharya <[email protected]>
* Update conda meta.yaml for 6.0.1 [skip test] * added documentation to file readers * updated docs for partition class in scala and python * fixed typos in sparkNLPReader and added documentation for Partition class * added parameters to Partition class and updated read function docs in Readers * updated readers documentation with ipynb path * updated partition description * fixed errors in email readers * fixed errors in email readers * added docs for partition transformer and pdf reader * added docs for python partition transformer and pdf reader * added docs for python partition transformer and pdf reader * updated docs to render partition and reader * reverted changes in init.py * reverted changes in imports * updated formatting docs for pdf reader * updated formatting of docs for spark nlp reader * updated formatting of docs for partition * updated formatting of docs for partition_transformer * updating links to notebooks and partition transformer description --------- Co-authored-by: Devin Ha <[email protected]> Co-authored-by: Paulami Bhattacharya <[email protected]>
Description
This PR adds documentation and examples for the Partition class, PartitionTransformer and various document readers in spark-nlp.
Motivation and Context
Helps users understand how to use Partition and Readers to read different types of Documents.
How Has This Been Tested?
Verified Scala docs on local
Screenshots (if appropriate):
Types of changes
Checklist: