Ticket #158 (accepted enhancement)

Opened 11 years ago

Last modified 10 years ago

xuvtools: save overlay to HDF5 by storing individual substacks, to save memory

Reported by: emmenlau Owned by: emmenlau
Priority: major Milestone:
Component: xuvtools Version:
Keywords: xuvtools, save, overlay, memory, crash Cc: srdatta@…, developer@…


When saving to HDF5, store the individual substacks one by one, rather than overlaying them in RAM. This will reduce the amount of needed memory for saving the overlay dramatically.

Runtime should not increase severely.

Change History

Changed 11 years ago by emmenlau

  • cc srdatta@… added

Added the original reporter to the watchers list.

Original report: Whenever I tile an image (of any size) the software works great. When I go to save the tiled images, however, things slow to a crawl. I have 24GB RAM on my computer, and usually at the point when the image is 39 percent saved the RAM gets completely filled and the saving process slows down. It never crashes, and if I let it go for a day or so eventually the image gets saved off. Is there anything I can do about this - does this relate to the way image saving is handled by the software?

Changed 10 years ago by emmenlau

  • status changed from new to accepted
  • type changed from defect to enhancement
Note: See TracTickets for help on using tickets.