How to use the masonry layout in a CustomScrollView

[snapsl]

Hi,
how can I use the masonry grid sliver in a CustomScrollView?
My code looks like the following:

    CustomScrollView(slivers: [
      SliverMasonryGrid(
        gridDelegate: const SliverSimpleGridDelegateWithFixedCrossAxisCount(
          crossAxisCount: {...},
        ),
        delegate: SliverChildBuilderDelegate(
          childCount: {...},
          (BuildContext context, int index) {
            {...}
          },
        ),
      )
    ]);

But simple scrolling doesn't work properly, causing the scrollbar to jump unpredictably.