Repo clean up and changed the tokenizer so it doesn't stringify tokens with a line break.

2020-07-26 02:11:04 -05:00
parent fc7f1e0dbf
commit 9c30eea95f
9 changed files with 2 additions and 530 deletions
@@ -1,3 +1,5 @@
 __pycache__
 *.json
 *.txt
+*.csv
+.*