Issues

• HTML_Entities dependency doesn't work with PackageCompiler

  JuliaText/WordTokenizers.jl#65 · Filter by author AbrJA opened on Aug 13, 2024

• Sentence tokenization must ignore newline as whitespace in the default mode.

  JuliaText/WordTokenizers.jl#60 · Filter by author sambitdash opened on Feb 26, 2021

• Interest in Improving Sentence Tokenization

  JuliaText/WordTokenizers.jl#59 · Filter by author TheCedarPrince opened on Jan 18, 2021
  2

• Benchmark against Rust library

  JuliaText/WordTokenizers.jl#46 · Filter by author oxinabox opened on Feb 5, 2020

• Sentence spliting of sentences with out whitespace after period

  JuliaText/WordTokenizers.jl#38 · Filter by author oxinabox opened on Oct 11, 2019
  2

• split_sentences - handling spaces after "."

  JuliaText/WordTokenizers.jl#32 · Filter by author Ayushk4 opened on Jun 27, 2019
  7

• tokenize API

  JuliaText/WordTokenizers.jl#11 · Filter by author MikeInnes opened on Oct 12, 2018
  9