Insted of creating the SDF out of spheres, with some help from the discord, I got a working Perlin Noise primitive for SDF. Along with generating the world in chunks, it boosts performance and quality. I've also tweaked the Perlin algorithm to create fractal Perlin noise (aka just better Perlin Noise), making the world look much more natural. Along with some water you can swim in, the world is starting to come together.