I had three issues: As mentioned earlier by firelynx if dtype is explicitly specified and there is mixed data that is not compatible with that dtype then loading will crash. One row might be "81287", another might be "97324-32". The warning is telling you that this happened at least once in the read in, so you should be careful. Have a little mapping: def MapA(int1): if int1==0: return 'category1' elif int1==1: return 'category2' etc and make a new column of categorical data, Specify correct dtypes to pandas.read_csv for datetimes and booleans, http://pandas.pydata.org/pandas-docs/stable/generated/pandas.io.parsers.read_csv.html, The open-source game engine youve been waiting for: Godot (Ep. single character. from collections import defaultdict import to the pd.read_csv() call will make pandas know when it starts reading the file, that this is only integers. Personally, I think low_memory=True is a bad default, but I work in an area that uses many more small datasets than large ones and so convenience is more important than efficiency. Press J to jump to the feed. Well actually thats an excellent point.the new project where the same workaround didn't work could be a subtle different version ill check it tomorrow! require(["mojo/signup-forms/Loader"], function(L) { L.start({"baseUrl":"mc.us18.list-manage.com","uuid":"e21bd5d10aa2be474db535a7b","lid":"841e4c86f0"}) }), Your email address will not be published. integer indices into the document columns) or strings To subscribe to this RSS feed, copy and paste this URL into your RSS reader. the behavior is identical to header=0 and column names are inferred from 'boolean' is like the numpy 'bool' but it also supports missing data. Get regular updates on the latest tutorials, offers & news at Statistics Globe. ' or ' ') will be 'string' is a specific dtype for working with string data and gives access to the .str attribute on the series. are patent descriptions/images in public domain? Adding