1 points | by ppipada 4 hours ago ago
1 comments
tl;dr: Normal human habits like swapped letters, fillers, shorthand, pasted IDs, and nearby word forms can change token count without changing intent much.
tl;dr: Normal human habits like swapped letters, fillers, shorthand, pasted IDs, and nearby word forms can change token count without changing intent much.