Distributed Tucker for Sparse Tensors

Abstract

We study the problem of constructing the Tucker decomposition of sparse tensors on distributed memory systems via the HOOI method. The scheme used for distributing the input tensor among the processors critically influences the HOOI execution time. Prior work has proposed different distribution schemes: an offline scheme based on sophisticated hypergraph partitioning method and simple, lightweight alternatives that can be used real-time. While the hypergraph based scheme typically results in faster HOOI execution time, being complex, the time taken for determining the distribution is an order of magnitude higher than the execution time of a single HOOI iteration. Our main contribution is a lightweight distribution scheme, which achieves the best of both worlds. We show that the scheme is near-optimal on certain fundamental metrics associated with the HOOI procedure and as a result, near-optimal on the computational load (FLOPs).

Date
Location
Spokane, WA