AI accelerators improve performance and efficiency for neural networks; evolving them for general-purpose computing requires new hardware, software, and programming models. In this article, we argue for the potential of general-purpose AI computing, highlight some challenges, and present initial results to motivate the feasibility.