As soon as you've saved the KPI and update the page, it just goes back to being unsaved again.  Ticket 29337.