I have a PHP code that allows me to read a csv file, insert the data into the database and move this file to another folder once the processing is finished.

This code works by default with UTF8 BOM files, I added the line fseek($handle, 3); to pass the first 3 characters.

I would like to know how I can execute the same code for UTF8 files by integrating the lines directly or in UTF8 BOM by starting after the first 3 characters?

<?php

include("connexion.php");

$dir   = '//server/d$/ftp/GET/';
$allFiles = scandir($dir);
$dest = '//server/d$/ftp/GET/COPIES/';

foreach($allFiles as $file) {

    if (!in_array($file,array(".","..")))
    { 
        $file = $dir.$file;
        $filename = basename( $file );
        
        if ( strpos( $filename, 'BI1_' ) === 0 ) 
        {
            
            if (($handle = fopen($file, "r")) !== false) 
            {
                 
                //To remove BOM in the first cell
                 fseek($handle, 3);   
                  
                     $bi1_values =  array();
                     while (($data = fgetcsv($handle, 9000000, ";")) !== false) 
                        {                                         
                                $bi1_values[] = "('$data[0]', '".str_replace("'", "''",$data[1])."','$date1','$date2','$data[2]','$data[4]','".str_replace("'", "''",$data[5])."','".str_replace("'", "''",$data[6])."')";                 
                                if (count($bi1_values) == 1000) 
                                { 
                                    $query = "insert into dbo.Sales (storenumber, storename, date, time, TransRef, stylecode, color, size) 
                                    values " . implode(',', $bi1_values);
                                    $stmt = $conn->query( $query );
                                    
                                    if (!$stmt) 
                                    { 
                                            $file1 = "D:/xampp/htdocs/errors/erreur_BI1.txt";                       
                                            file_put_contents($file1, $query . PHP_EOL, FILE_APPEND | LOCK_EX);
                                    }   
                                    $bi1_values = array();
                                } 
                        }
                        
                    fclose($handle);
                      
                    //Moving the file to another folder             
                    if(!rename($file, $dest . $filename)) 
                    { 
                        echo "error";
                    }                
                }
            }
    }
}

?>

CodePudding user response：

Leave the file as is and remove the BOM characters from the $data array. So you can process both files with BOM and without BOM. Roughly:

$firstRow = true;
while (($data = fgetcsv($handle, 9000000, ";")) !== false) {
  if($firstRow) {
    $data[0] = str_replace("\xef\xbb\xbf","",$data[0]);
    $firstrow = false;
  }
  //..

"\xef\xbb\xbf" is the string notation for a BOM.