-
Notifications
You must be signed in to change notification settings - Fork 32
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Bug]: Pixel_mask doesn't seem to be properly constructed. #572
Comments
I wrote earlier that writeCompound converted all the fields to doubles. That is not true, my structure arrays were not formatted properly. I changed my code and now the structure arrays keep their original data types uint32, uint32, single. |
In order to create a proper compound type for pixel_masks you could do the following (see code below). Note: this is one way I found that worked, and this process should be documented better for matnwb. Another note; as I do not have your ROI_data structure, I have not run the code to verify that it works. But the key is to use a struct where each field is a vector of all the concatenated values for x, y and weight respectively, and to also specify the pixel_mask_idx to create a ragged array A second note: In order to visualise these masks in neurosift you need to add an image (i.e a fov projection image) in the ophys processing module. This is because there is no information about the image size in the pixel mask data, and neurosift needs to know the image size in order to reconstruct the masks in a plot. Neurosift does that by looking for an A final note: I could not reproduce exactly the view that Ben posted above for the pixel_mask property when looking at the raw view in neurosift, even though the code below should organise the data in the NWB file in the exact same way as the example file from Ben's screenshot. Create a plane segmentation with pixel masks imaging_plane = []; % Should be replaced with an actual image plane object (Used below).
% Initialize data
[x, y] = deal([]);
num_pixels_per_roi = zeros(nRois, 1); % Column vector
% Collect x and y indices for all rois in a column vector
for i = 1:nRois
[iy, ix] = find(ROI_data.Mask == i);
x = cat(1, x, ix(:)'); % Create a column vector
y = cat(1, y, iy(:)');
num_pixels_per_roi(i) = numel(ix);
end
% Create a struct
pixel_mask = struct;
pixel_mask.x = uint32(x);
pixel_mask.y = uint32(y);
pixel_mask.weigth = single(ones(size(x)));
% Create pixel_mask_idx vector
pixel_mask_idx = types.hdmf_common.VectorIndex(...
'description', 'Index into pixel_mask VectorData', ...
'data', cumsum(num_pixels_per_roi), ...
'target', types.untyped.ObjectView('/processing/ophys/ImageSegmentation/PlaneSegmentation/pixel_mask') );
plane_segmentation = types.core.PlaneSegmentation( ...
'colnames', {'pixel_mask'}, ...
'description', 'roi pixel position (x,y) and pixel weight', ...
'id', types.hdmf_common.ElementIdentifiers('data', int64(0:nRois-1)'), ...
'imaging_plane', types.untyped.SoftLink(imaging_plane), ...
'pixel_mask_index', pixel_mask_idx, ...
'pixel_mask', types.hdmf_common.VectorData('data',struct2table(pixel_mask), 'description', 'pixel masks') ...
);
% When adding the compound pixel_mask to data struct2table is used. This was based on another example in the convertTrials tutorial. Adding a mock projection image so neurosift can resolve the image (fov) size imgs = types.core.Images('description', 'projections')
img = types.core.Image('description', 'projection', 'data', zeros(512,512))
imgs.image.set('projection_image', img)
ophys_module.nwbdatainterface.set('ImageProjection', imgs); @chrisvdt Let me know if you have a chance to test this and if it works for you or not! |
nice work, @ehennestad ! Can you copy/paste a screenshot of the neurosift raw view? |
@ehennestad Many thanks, it works now. The crucial difference was this line: 'data', cumsum(num_pixels_per_roi), ... I tried various ways of creating a struct for the x,y and weight values. And ended up making a struct array. But this really made no difference, since the matnwb script writeCompound, converts the struct array to a single struct with three arrays like you demonstrated. |
Hmm, strange that the pixel mask still shows up as "object Object". @ehennestad could you take a look in HDFView? |
I have compared the example file on dandiarchive with one I generated using matnwb. It is notable that the pixel_mask_index also have a different raw view for files generated in matnwb vs the file on dandi. I have inspected / compared the two files using both matnwb and h5disp and the pixel_mask datasets appears identical. There were some differences in pixel_mask_index. I will look into how neurosift generates the view, maybe that can give some hints why the raw view is different |
…) (#577) * Add example for creating pixel mask to ophys tutorial * Change default selection for how to create rois * Use object instead of path in ObjectView per suggestion by Ben * Remove explicit assignment of "ids" to PlaneSegmentation * Fix nwb file name --------- Co-authored-by: Ben Dichter <[email protected]>
fixed by #577 |
What happened?
Although my nwb object does get exported to an NWB file without errors, and the validation with python is successfull, I cannot view the Imagesegmentation in neurosift.
A raw view shows that the pixel_map is not a compound datatype object array.
![afbeelding](https://private-user-images.githubusercontent.com/5311644/341776412-c5334262-4a1c-4b02-ada5-2a51106e8ce1.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjU5NzQyNzcsIm5iZiI6MTcyNTk3Mzk3NywicGF0aCI6Ii81MzExNjQ0LzM0MTc3NjQxMi1jNTMzNDI2Mi00YTFjLTRiMDItYWRhNS0yYTUxMTA2ZThjZTEucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDkxMCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA5MTBUMTMxMjU3WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9MjJjMzI5NDU5ODA0YzhlMzI1MWMyNWFjNzU3YzA3Y2M4MmUwNzU3ZjNkYTE4Yjc2ZWNjNDk4MWU2ODg3YmM5ZSZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.Qvmht3hQXdVYWqjcCKC-nNQgUcmnXdRSBNxHZg_PmaM)
I made this structure array with struct('x', uint32(0), 'y', uint32(0), 'weight', single(0)). But I see that matnwb writeCompound converts them all to doubles.
Steps to Reproduce
Error Message
No response
Operating System
Windows
Matlab Version
matlab R2021a
Code of Conduct
The text was updated successfully, but these errors were encountered: