A Japanese startup came closer to a private lunar landing than anyone before, only to lose contact in the final seconds of descent.