Text
TensorFlow provides you with a rich collection of ops and libraries to help you work with input in text form such as raw text strings or documents. These libraries can perform the preprocessing regularly required by text-based models, and includes other features useful for sequence modeling. You can extract powerful syntactic and semantic text features from inside the TensorFlow graph as input to your neural net. In addition to the above, you do not need to worry about tokenization in training being different than the tokenization at inference, or managing preprocessing scripts.
May-19-2021, 20:07:08 GMT
- Technology: