Used memory

[bgranvea]

I'm currently implementing a strategy which limits the size of my inserts based on memory constraints, because in some cases I have many parallel insert buffers in memory and I would like to be sure that they all together don't exceed some max memory setting.

My idea would be to define a method like this:

func (c *Base[T]) UsedMemory() uint64 {
	return uint64(cap(c.values) * int(c.rtype.Size()))
}

I'm using cap() instead of len() as it reflects the allocated memory. Not sure if the function should return an uint64 or another type.

From what I see in the code it shouldn't be too difficult to implement. There are some subtleties for some types (low cardinality...) but it seems doable. One point not very clear to me is that some structures seems to be used for written data, other for read data. My use case is to measure memory for writes only, but read data could be captured too.

What do you think?

[vahid-sohrabloo]

Yes. for most types it's possible.
maybe we can add something like WriterBufferSize or WriterBufferCap.
I was working on the v3. But now I am involved in a family issue. I will probably be working on this in about two weeks.
Of course, you can also make a pull request.