PS the right tool for textfile manipulation?

Welcome Forums General PowerShell Q&A PS the right tool for textfile manipulation?

Viewing 1 reply thread
  • Author
    Posts
    • #197876
      Participant
      Topics: 1
      Replies: 0
      Points: 11
      Rank: Member

      Hi,

      This is my first post here. Im a powershell beginner, but also a unix shell script programmer for 10 years (20 years ago).

      I used to manipulate text files with unix shell scripts. Which was fast enough. Now i am facing a fixed width text file with 23 mln records/lines.

      I was wondering, if PS is fast enough to handle large text files?

      Otherwise i am forced to learn ACL.

      Thanks for your time.

      Guus

    • #197906
      Participant
      Topics: 10
      Replies: 1381
      Points: 1,509
      Helping Hand
      Rank: Community Hero

      Assuming you mean 23 million records\lines, yes that is a large file. 🙂 There are numerous articles that discuss processing large files in Powershell, like this one:

      http://www.happysysadm.com/2014/10/reading-large-text-files-with-powershell.html

      I was wondering, if PS is fast enough to handle large text files?

      This is relative as you are not really providing requirements or a measure of how fast it can be done in Shell for comparison, but youll need to test what you are attempting to do. As far as manipulation, Powershell supports multiple methods to fully parse and manipulate text from Select-String to Regex.

Viewing 1 reply thread
  • You must be logged in to reply to this topic.