Comparing Transformer Tokenizers
Published:
Comparing Tokenizer vocabularies of State-of-the-Art Transformers (BERT, GPT-2, RoBERTa, XLM) See full article here
Gergely Dániel Németh
PhD student at the ELLIS Unit Alicante. Working on AI Fairness in Federated Learning.
- Alicante, Spain
- Github
- Google Scholar
You May Also Enjoy
Analyzing data augmentation for image classification
less than 1 minute read
Published:
PCA analysis of image augmentation techniques used in the state of the art image classification models See full article here
Customize Classification Model Output Layer
less than 1 minute read
Published:
Save classification labels and top confidences in a custom layer using Keras See full article here
Find Linear Transformation Based on Known Points
less than 1 minute read
Published:
Code Snippet for Linear Algebra and Computer Vision See full article here
BERT Visualization in Embedding Projector
less than 1 minute read
Published:
This story shows how to visualize pre-trained BERT embeddings in Tensorflow’s Tensorboard Embedding Projector. The story uses around 50 unique sentences and their BERT embeddings generated with TensorFlow Hub BERT models. See full article here