Calcium oxalate stones affect millions of people and can cause real discomfort. Most people that form crystals think that it may have been something to do with a poor diet. While this is definitely a possibility, there can be a strong genetic link. It may not be your fault you are developing calcium oxalate crystals.