In previous work, we proposed integrating the idea of treating sparsity as a property of tensors, and not a tedious implementation task, into the MLIR compiler infrastructure. This has resulted in an open-source pipeline for sparse compilation by means of a new sparse tensor dialect. In this talk, we will discuss some interesting engineering problems we encountered while integrating the pipeline into a production compiler, in particular for the JAX framework extended with sparse tensor support.