Yes, this product can charge a 24V lithium battery, but a controller is required. If the battery does not come with a controller, the solar panel will need a 30A controller or an inverter of 200W or higher.
If you are using a controller with a capacity of 300A or higher, that's fine. If you are using an inverter with a capacity greater than 200W, that's also fine.