Spark is helping solve some really complex genomics problems

databricks.com

People get hung up on deep learning and other AI techniques for medical breakthroughs, but Spark is proving really useful, too. Here, an Australian government agency details its system for analyzing genomic datasets with millions of features. Back in 2014, I spoke with David Patterson (then at UC-Berkeley) about how Spark and big data were already helping doctors diagnose diseases. That was more about applied computational medicine, whereas this genomics work is research, but it's good to see how open source technologies can mature and end up solving important problems in fields outside their initial targets.

Read more...
Linkedin

Want to receive more content like this in your inbox?