How do you evaluate a foundation model before you know what it's for?
Posted by galsapir 20 hours ago
Comments
Comment by galsapir 20 hours ago
foundation models in biology still haven't proven they're worth it vs simpler methods (imo). we just published one in Nature, and i feel i spent more time on "how will we know this worked" than on the model itself. the hard part was (mostly) deciding what success even means. open for thoughts