View Issue Details

This bug affects 1 person(s).
 10
IDProjectCategoryView StatusLast Update
18102Bug reportsImport/Exportpublic2022-06-20 08:21
Reporterahhsung Assigned ToDenisChenu  
PrioritynoneSeverityminor 
Status confirmedResolutionopen 
Product Version5.3.x 
Summary18102: Export Duplicate entries in the Excel Form
Description

I am currently using LimeSurvey 5.1.10 and it is found that the there are duplicated entries in the Survey Result if there are more than 200 rows.

Steps To Reproduce

Steps to reproduce

Survey with more than 200 responses

Expected result

Export completed responses in Excel Format

Actual result

A few rows in the survey is duplicated

TagsNo tags attached.
Bug heat10
Complete LimeSurvey version number (& build)5.1.10
I will donate to the project if issue is resolvedNo
Browser
Database type & versionMSSQL Server 2016
Server OS (if known)Windows Server 2016
Webserver software & version (if known)
PHP Version8.0.10

Users monitoring this issue

User List Mazi

Activities

ahhsung

ahhsung

2022-05-13 04:57

reporter  

bug.png (40,409 bytes)   
bug.png (40,409 bytes)   
gabrieljenik

gabrieljenik

2022-05-13 15:11

manager   ~69624

Has this happened more than once?
Can you please provide more precise instructions on how to reproduce? Preferably in a step-by-step manner, like 1) Go to question x; 2) Click button y; 3) Expected z but saw v. Thank you very much.

ahhsung

ahhsung

2022-05-16 02:52

reporter   ~69643

Yes. This happened when the survey is more than 200 responses.
Also, it is found that there are no duplication in the submission table.

Step-by-Step manner:

  1. Select an survey with more than 200 responses
  2. Select Responses and Statistic under Responses
  3. Select Export responses under Export
  4. Select "Export Format" as Microsoft Excel and Completed Responses only
  5. Export

After that, the downloaded excel contains duplicated entries in the file.

Thank you.

gabrieljenik

gabrieljenik

2022-05-16 17:22

manager   ~69671

Does this happen on many surveys or just one?

DenisChenu

DenisChenu

2022-05-16 18:10

developer   ~69676

But here : it's not duplicate for sure. Order of id can be different when export thand ASC

Can you export the LSA (private upload is possible)

ahhsung

ahhsung

2022-05-17 03:07

reporter   ~69693

The problem happened in all the Surveys

DenisChenu

DenisChenu

2022-05-17 08:57

developer   ~69695

Can you export the 453141 data here ? Want to check something.
(i can not reproduce with the lsa)

DenisChenu

DenisChenu

2022-05-25 08:18

developer   ~70022

WTF …
No idea here …

hinghang

hinghang

2022-05-27 12:27

reporter   ~70066

Hi Denis,

I would like to supplement additional information to see if you could simulate our case.

  1. We are using Microsoft SQL Server 2016 as the database
  2. I have tried to install the latest version, i.e. v5.3.17+220525 and import the lsa, the problem still occurs

I am wondering if it is related to the database we are using.

Thank you.

DenisChenu

DenisChenu

2022-05-27 14:15

developer   ~70067

Oh,
let let check on MS SQL

gabrieljenik

gabrieljenik

2022-06-03 22:53

manager   ~70220

I am sorry. I wasn't able to reproduce the issue.
Maybe you have 2 copies of the plugins working together?

Can you please try on a fresh installation?
I am sorry to suggest this, but not sure there is much to suggest without debugging on your ENV (which is kind of out of the scope) :) Hope you understand.

Thanks

hinghang

hinghang

2022-06-06 02:56

reporter   ~70223

I have tried to import the LSA in a fresh installation of the limesurvey and the issue is still exists.
I am not sure if the issue is related to the environment or not.

We are using Windows Server 2016 with SQL Server 2016 as the database.

gabrieljenik

gabrieljenik

2022-06-06 14:09

manager   ~70228

let let check on MS SQL

@DenisChenu Were you able to reproduce with MsSQL?

DenisChenu

DenisChenu

2022-06-06 15:57

developer   ~70241

Need to found time …

hinghang

hinghang

2022-06-07 04:12

reporter   ~70257

hi Gabriel & Denis,

I have just tried to install the a clean LimeSurvey Version 5.3.17+220525 , SQL Server 2016, PHP 8.1 and php_pdo_sqlsrv_81 in another Windows Server and import the LSA again.
The export issue also exist.

I think it is very likely a SQL server issue.

DenisChenu

DenisChenu

2022-06-07 15:04

developer   ~70281

Issue confirmed with 5.3.9 / PHP 7.4.27 / IIS/10.0 / SQLServer 15

happen after 763 id, goes to 673 id (already export before

I update to last and check again.

DenisChenu

DenisChenu

2022-06-09 19:49

developer   ~70326

last git : confirmed

DenisChenu

DenisChenu

2022-06-09 20:02

developer   ~70327

timing related ?

    'from' => '[{{survey_453141}}]'
    'join' => array
    (
        0 => 'LEFT JOIN [{{survey_453141_timings}}] [survey_timings] ON {{survey_453141}}.id = survey_timings.id'
    )
    'where' => '{{survey_453141}}.id >= :min AND {{survey_453141}}.id <= :max'
    'order' => '[{{survey_453141}}].[id] ASC'
    'select' => '[{{survey_453141}}].[id], [survey_timings].[interviewtime], [survey_timings].[453141X27time], [survey_timings].[453141X27X830time], [survey_timings].[453141X27X834time], [survey_timings].[453141X27X835time], [survey_timings].[453141X27X831time], [survey_timings].[453141X27X832time], [survey_timings].[453141X27X833time], [survey_timings].[453141X27X836time]'
)
hinghang

hinghang

2022-06-20 05:27

reporter   ~70410

Hi Denis,

I am not sure about the source code above...

DenisChenu

DenisChenu

2022-06-20 08:21

developer   ~70411

@hinghang : it the instruction done when try to export data with MS SQL.
It's a really hard issue to fix … 1. i don't have a direct access to a SQL database ;) 2. There are no clean error error here 3. No issue in code 4. SQL issue like this is always more complex to trace …

Issue History

Date Modified Username Field Change
2022-05-13 04:57 ahhsung New Issue
2022-05-13 04:57 ahhsung File Added: bug.png
2022-05-13 15:11 gabrieljenik Assigned To => gabrieljenik
2022-05-13 15:11 gabrieljenik Status new => feedback
2022-05-13 15:11 gabrieljenik Note Added: 69624
2022-05-13 15:11 gabrieljenik Bug heat 0 => 2
2022-05-16 02:52 ahhsung Note Added: 69643
2022-05-16 02:52 ahhsung Bug heat 2 => 4
2022-05-16 02:52 ahhsung Status feedback => assigned
2022-05-16 17:22 gabrieljenik Note Added: 69671
2022-05-16 18:10 DenisChenu Note Added: 69676
2022-05-16 18:10 DenisChenu Bug heat 4 => 6
2022-05-17 03:07 ahhsung Note Added: 69693
2022-05-17 08:57 DenisChenu Note Added: 69695
2022-05-17 08:57 DenisChenu File Added: Capture d’écran du 2022-05-17 08-56-44.png
2022-05-17 12:11 Mazi Issue Monitored: Mazi
2022-05-17 12:11 Mazi Bug heat 6 => 8
2022-05-25 02:36 hinghang Bug heat 8 => 10
2022-05-25 08:18 DenisChenu Note Added: 70022
2022-05-27 12:27 hinghang Note Added: 70066
2022-05-27 14:15 DenisChenu Note Added: 70067
2022-06-03 22:53 gabrieljenik Status assigned => feedback
2022-06-03 22:53 gabrieljenik Note Added: 70220
2022-06-06 02:56 hinghang Note Added: 70223
2022-06-06 14:09 gabrieljenik Note Added: 70228
2022-06-06 15:57 DenisChenu Note Added: 70241
2022-06-07 04:12 hinghang Note Added: 70257
2022-06-07 07:58 DenisChenu Assigned To gabrieljenik => DenisChenu
2022-06-07 15:04 DenisChenu Note Added: 70281
2022-06-07 15:04 DenisChenu Status feedback => confirmed
2022-06-09 19:49 DenisChenu Note Added: 70326
2022-06-09 20:02 DenisChenu Note Added: 70327
2022-06-20 05:27 hinghang Note Added: 70410
2022-06-20 08:21 DenisChenu Note Added: 70411