Skip to content

Commit b2b9c5c

Browse files
Update _posts/2021-03-11-dask_memory_usage.md
Co-authored-by: Genevieve Buckley <30920819+GenevieveBuckley@users.noreply.github.com>
1 parent 0f3f6c9 commit b2b9c5c

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

_posts/2021-03-11-dask_memory_usage.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -218,7 +218,7 @@ So the next step was to reduce memory usage.
218218
## Reducing memory usage with Fil {#fil}
219219

220220
If we look at the `dask-memusage` output for our word-counting example, the memory usage seems rather high: for a 25MB file, we're using 330MB of RAM to count words.
221-
Thinking through how an ideal version of this code might work, we ought to be able to process the file with much less memory.
221+
Thinking through how an ideal version of this code might work, we ought to be able to process the file with much less memory (for example we could redesign our code to process the file line by line, reducing memory).
222222

223223
**And that's another way in which `dask-memusage` can be helpful: it can point us at specific code that needs memory usage optimized, at the granularity of a task.**
224224
A task can be a rather large chunk of code, though, so the next step is to use a memory profiler that can point to specific lines of code.

0 commit comments

Comments
 (0)