[mlir][sparse] provide an AoS "view" into sparse runtime support lib (#87116)

Note that even though the sparse runtime support lib always uses SoA
storage for COO storage (and provides correct code

[mlir][sparse] provide an AoS "view" into sparse runtime support lib (#87116)

Note that even though the sparse runtime support lib always uses SoA
storage for COO storage (and provides correct codegen by means of views
into this storage), in some rare cases we need the true physical SoA
storage as a coordinate buffer. This PR provides that functionality by
means of a (costly) coordinate buffer call.

Since this is currently only used for testing/debugging by means of the
sparse_tensor.print method, this solution is acceptable. If we ever want
a performing version of this, we should truly support AoS storage of COO
in addition to the SoA used right now.

show more ...

[mlir][sparse] refactoring sparse runtime lib into less paths (#85332)

Two constructors could be easily refactored into one after a lot of
previous deprecated code has been removed.

[mlir][sparse] remove very thin header file from sparse runtime support (#82820)

[mlir][sparse] cleanup sparse runtime library (#82807)

remove some obsoleted APIs from the library that have been fully
replaced with actual direct IR codegen

Apply clang-tidy fixes for readability-identifier-naming in SparseTensorRuntime.cpp (NFC)

[mlir] Apply ClangTidy performance fix

- Use '\n' instead of std::endl;

https://clang.llvm.org/extra/clang-tidy/checks/performance/avoid-endl.html

[mlir][sparse] rename DimLevelType to LevelType (#73561)

The "Dim" prefix is a legacy left-over that no longer makes sense, since
we have a very strict "Dimension" vs. "Level" definition for sparse

[mlir][sparse] rename DimLevelType to LevelType (#73561)

The "Dim" prefix is a legacy left-over that no longer makes sense, since
we have a very strict "Dimension" vs. "Level" definition for sparse
tensor types and their storage.

show more ...

[mlir][sparse] remove obsoleted output methods from runtime (#70523)

Our CODE and LIB are more unified every day!

[mlir] Remove an extraneous typename (NFC)

[mlir][sparse] tiny cleanup making local 'using' explicit (#69740)

[mlir][sparse] implement non-permutation MapRef encoding (#69406)

This enables reading block sparse from file using libgen! (and soon also
direct IR codegen)

[mlir][sparse] complete migration to dim2lvl/lvl2dim in library (#69268)

This last revision completed the migration to non-permutation support in
the SparseTensor library. All mappings are now cont

[mlir][sparse] complete migration to dim2lvl/lvl2dim in library (#69268)

This last revision completed the migration to non-permutation support in
the SparseTensor library. All mappings are now controlled by the MapRef
(forward and backward). Unused code has been removed, which simplifies
subsequent testing of block sparsity.

show more ...

[mlir][sparse] remove sparse2sparse path in library (#69247)

This cleans up all external entry points that will have to deal with
non-permutations, making any subsequent refactoring much more local

[mlir][sparse] remove sparse2sparse path in library (#69247)

This cleans up all external entry points that will have to deal with
non-permutations, making any subsequent refactoring much more local to
the lib files.

show more ...

[mlir][sparse] simplify reader construction of new sparse tensor (#69036)

Making the materialize-from-reader method part of the Swiss army knife
suite again removes a lot of redundant boiler plate

[mlir][sparse] simplify reader construction of new sparse tensor (#69036)

Making the materialize-from-reader method part of the Swiss army knife
suite again removes a lot of redundant boiler plate code and unifies the
parameter setup into a single centralized utility. Furthermore, we now
have minimized the number of entry points into the library that need a
non-permutation map setup, simplifying what comes next

show more ...

[mlir][sparse] remove unused sparse tensor iterator (#68951)

[mlir][sparse] add a forwarding insertion to SparseTensorStorage (#68939)

[mlir][sparse] implement sparse_tensor.reorder_coo (#68916)

As a side effect of the change, it also unifies the convertOp
implementation between lib/codegen path.

[mlir][sparse] refactor dim2lvl/lvl2dim passing into MapRef (#68649)

This revision refactors all "swiss army knife" entry points to pass
dim2lvl/lvl2dim mapping, so that the callee can construct a

[mlir][sparse] refactor dim2lvl/lvl2dim passing into MapRef (#68649)

This revision refactors all "swiss army knife" entry points to pass
dim2lvl/lvl2dim mapping, so that the callee can construct a MapRef
(shown for SparseTensorStorage class). This is a next step towards
completely centralizing mapping code into a single MapRef class.

show more ...

[mlir][sparse] add expanded size to API (#68614)

Used for asserting we do not run out of bounds on the expanded access
pattern.

[mlir][sparse] replace specialized buffer setup with util code (#68461)

This completely centralizes all set up related to dim2lvl and lvl2dim
for the runtime library (and even parts of direct IR co

[mlir][sparse] replace specialized buffer setup with util code (#68461)

This completely centralizes all set up related to dim2lvl and lvl2dim
for the runtime library (and even parts of direct IR codegen) into one
place! And all comptatible with the MapRef data structure that should be
used in all remaining clients of dim2lvl and lvl2dim.

NOTE: the convert_x2y.mlir tests were becoming too overloaded
so I decided to bring them back to the basics; if e.g.
more coverage of the foreach is required, they should
go into isolated smalle tests

show more ...

[mlir][sparse] introduce MapRef, unify conversion/codegen for reader (#68360)

This revision introduces a MapRef, which will support a future
generalization beyond permutations (e.g. block sparsity)

[mlir][sparse] introduce MapRef, unify conversion/codegen for reader (#68360)

This revision introduces a MapRef, which will support a future
generalization beyond permutations (e.g. block sparsity). This revision
also unifies the conversion/codegen paths for the sparse_tensor.new
operation from file (eg. the readers). Note that more unification is
planned as well as general affine dim2lvl and lvl2dim (all marked with
TODOs).

show more ...

[mlir][sparse] deprecate the convert{To,From}MLIRSparseTensor methods (#66304)

Rationale:
These libraries provided COO input and output at external boundaries
which, since then, has been generaliz

[mlir][sparse] deprecate the convert{To,From}MLIRSparseTensor methods (#66304)

Rationale:
These libraries provided COO input and output at external boundaries
which, since then, has been generalized to the much more powerful pack
and unpack operations of the sparse tensor dialect.

show more ...

[mlir][sparse] simplification of sparse runtime support lib

Incorporated two header files directly into other since
other parts were used (and it makes it hard to find the
definitions). Removed TODO

[mlir][sparse] simplification of sparse runtime support lib

Incorporated two header files directly into other since
other parts were used (and it makes it hard to find the
definitions). Removed TODOs that are less likely to be done.

Reviewed By: yinying-lisa-li

Differential Revision: https://reviews.llvm.org/D159381

show more ...

Revert "[mlir][sparse] simplification of sparse runtime support lib"

This reverts commit 14c58cf5c39a39a335893bc98493c5edc75a91b3.

The gcc7 build is broken.

[mlir][sparse] simplification of sparse runtime support lib

Incorporated two header files directly into other since
other parts were used (and it makes it hard to find the
definitions). Removed TODO

[mlir][sparse] simplification of sparse runtime support lib

Incorporated two header files directly into other since
other parts were used (and it makes it hard to find the
definitions). Removed TODOs that are less likely to be done.

Reviewed By: Peiming

Differential Revision: https://reviews.llvm.org/D159330

show more ...