What is the max amount of data that is practical with dataToJson?

dan.tilley · December 13, 2022, 5:33pm

I have spooked myself…

I have a vague memory of recently reading something about saving too much data via the JSON methods and what an appropriate alternative might be… but now I can’t find it

I am looking into making my Kalkatron module polyphonic so my concern is that the number of variables I am storing currently (which would likely increase as I add more functions) multiplied by the 16 channels would end up being too much data to be practical.

Do I correctly recall the JSON data might be truncated in some circumstances?

Can anyone point me to this memory, or shed any light on how much data the JSON methods can reasonably handle?

Vortico · December 13, 2022, 5:48pm

Around 100 kB I’d switch to using module patch storage.

dan.tilley · December 13, 2022, 5:53pm

Thanks Andrew, are there any docs on that, or an example?

dan.tilley · December 13, 2022, 5:58pm

Ah not to worry, found an example here

github.com

VCVRack/Fundamental/blob/45b4a6ebfa6790611ef2b181470b21f910b2a44c/src/WTLFO.cpp#L109


      
          	}
          
          
	void onAdd(const AddEvent& e) override {
          		std::string path = system::join(getPatchStorageDirectory(), "wavetable.wav");
          		// Silently fails
          		wavetable.load(path);
          	}
          
          
	void onSave(const SaveEvent& e) override {
          		if (!wavetable.samples.empty()) {
          			std::string path = system::join(createPatchStorageDirectory(), "wavetable.wav");
          			wavetable.save(path);
          		}
          	}
          
          
	void process(const ProcessArgs& args) override {
          		float freqParam = params[FREQ_PARAM].getValue();
          		float fmParam = params[FM_PARAM].getValue();
          		float posParam = params[POS_PARAM].getValue();
          		float posCvParam = params[POS_CV_PARAM].getValue();
          		bool offset = (params[OFFSET_PARAM].getValue() > 0.f);

dan.tilley · December 14, 2022, 6:41pm

Totally didn’t need to be concerned, even with 13 multi-channel variables and 19 singular variables in my data, storage only works out to ~8kb, good to know I am nowhere near pushing the JSON limits