Skip to main content
leonardo's user avatar
leonardo's user avatar
leonardo's user avatar
leonardo
  • Member for 3 years, 1 month
  • Last seen more than 2 years ago
awarded
revised
Loading…
comment
Cleaning up a PANDAS dataframe of Brazilian football statistics
@pacmaninbw Yes I can however, if any little case I can help in the case of accelerating the processing of this/pandas workflow/s on Windows 11, it can be great as my son loves the look and feel of Win 11 and I want to go with it.
comment
Cleaning up a PANDAS dataframe of Brazilian football statistics
Because its a very large dataframe (500 MB) and without multiprocessing the code takes about 35 mins to execute while with Modin it takes about 4 mins. Since I have upgraded to Windows 11, Modin (Ray and Dask) library does not work. I was wondering if multiprocessing can make the job faster. I have a 16 core processor and a 3080 GPU. Multiprocessing can help in this case.
Loading…
awarded
accepted
comment
Cleanup dataset for visualization
How do I save the resulting dataframe to_csv?
comment
Cleanup dataset for visualization
Can I ask for a solution for the same code but using cudf on this platform? How can I ask it?
comment
Cleanup dataset for visualization
@greybeard I have updated the code and corrected spelling mistakes. Thank you
revised
Cleanup dataset for visualization
Corrected code, edited spelling mistakes and added explanations
Loading…
comment
Cleanup dataset for visualization
Thank you. The code is much cleaner and I get that building functions is a better way to approach this. However, I am still getting the same time as my earlier code and I still get the Boolean Reindexing warning. While I understand, the time cannot be improved however, can I resolve the reindexing warning I get at df = df[~n] and df = df[~o] ?
comment
Cleanup dataset for visualization
Thank you for your feedback. I have updated the body of my question. Is there anything else I should be clarifying?
revised
Cleanup dataset for visualization
Corrected body, updated explanation and added comments to functions
Loading…
revised
Cleanup dataset for visualization
corrected question, added file link
Loading…
revised
Loading…
awarded
revised
Cleanup dataset for visualization
deleted 1 character in body
Loading…
asked
Loading…