SSIS Tutorial: How to split a large CSV into multiple files

SSIS Tutorials
, ,
1

Introduction

In this tutorial, we’ll guide you through the process of splitting rows from a source into multiple CSV files using ZappySys SSIS PowerPack. This is useful when you need to manage large datasets by splitting them into smaller files based on row count or file size.

Prerequisites

Steps

  1. In the Control Flow tab, drag and drop a Data Flow Task into the package, then open it.

  2. Drag a JSON Source component into the Data Flow and double-click to configure it.

  3. For this example, select Example 4, which contains 500 rows. Click OK to save the configuration.

    JSON source configuration
    JSON source configuration828×745 48 KB

  4. In the Connection Managers area, right-click and select New File Connection.

  5. Choose an existing CSV file or use Create file to define a new file path and name.

  6. Drag a CSV Destination component into the Data Flow, connect it to the JSON Source, and open it to configure.

  7. In the Connection Manager tab, select the file connection you created earlier.

  8. Go to the Component Properties tab and find the FileSplitMode property. Choose whether to split by rows or by size.

    CSV destination select split mode
    CSV destination select split mode723×664 20.7 KB

  9. If you select Size, set the MaxSizePerFile property. You can specify the maximum size using format specifiers such as bytes, kb, mb, gb, or tb (for example, 100mb).

  10. If you select Rows, set the MaxRowsPerFile property (default: 100000). In this example, we’ll use 100 rows per file.

    CSV destination set row/size
    CSV destination set row/size723×664 21.4 KB

  11. Go to the Input Columns tab and check the columns you want to include in the CSV file.

  12. Click OK to save the configuration.

  13. Run the package.

    Final result
    Final result285×280 10.5 KB

  14. You should now see five CSV files, each containing 100 rows of data.

    Files created
    Files created905×339 34.6 KB

Conclusion

By following these steps, you can easily split large datasets into smaller, more manageable CSV files using the ZappySys CSV Destination. This approach helps improve performance, simplify data storage, and streamline data management in your SSIS workflows.

Explore our SSIS PowerPack for more information and download and install it to start building smarter, faster, and more scalable solutions.

References

Contact us

If you encounter any issues or have specific questions, reach out to our support team via live chat or support ticket using our email support@zappysys.com.