stefano-m/python-partition_large_file: An example of how one can partition a large file and process it in parallel. The core function is `partition`. Also look at how multiprocessing's starmap_async is used to get the result.

An example of how one can partition a large file and process it in parallel. The core function is `partition`. Also look at how multiprocessing's starmap_async is used to get the result.

2 Achegas

1 Branches

0 Lanzamentos

Stefano Mazzucco fb65c2920c Remove chunksize from starmap_async		%!s(int64=6) %!d(string=hai) anos
.gitignore	ea7b960efa Partition large file and process chunks in parallel	%!s(int64=6) %!d(string=hai) anos
LICENSE	ea7b960efa Partition large file and process chunks in parallel	%!s(int64=6) %!d(string=hai) anos
README	ea7b960efa Partition large file and process chunks in parallel	%!s(int64=6) %!d(string=hai) anos
partition.py	fb65c2920c Remove chunksize from starmap_async	%!s(int64=6) %!d(string=hai) anos

		
				README
			
				An example of how one can partition a large file and process it in parallel.
The core function is `partition`.  Also look at how multiprocessing's
starmap_async is used to get the result.