How to configure a synchronizationTask with a file including a wildcard

Resolved

Hello,

I would like to synchronize with a .csv file that is uploaded daily to the Memority SFTP.
This file is generated every day and contains the date and time in its name. In my ConnectorDefinition file, I have defined the tag :

<connectorProperty>
<name>dataUri</name>
<value>s3:/file/DAILY_FILE_*.csv</value>
</connectorProperty>

As well as the property:

<connectorProperty>
<name>maxNumberOfFilesMatchingPattern</name>
<value>1</value>
</connectorProperty>

Unfortunately, when I launch my synchronization task, I get the following error:

“Wildcard(s) are not allowed in the file path s3:/file/DAILY_FILE_*.csv when executing directly a SynchronizationTask”

How can I ensure that my .csv file containing a wildcard is taken into account?

Thank you in advance.

Import, export & provisioning
1 reply
Best reply by Paul LEDOUX

Hello Paul,

When the file to be retrieved from SFTP contains a wildcard, a single synchronizationTask cannot retrieve it.

To do this, you need to set up an orchestrationTask that will call our syncTask.

Exemple:

<orchestratedTasks>
<orchestratedTask>
<taskId>Your-syncTask-Id</taskId>
<taskType>Your-syncTask-Type</taskType>
<taskExecutionCondition>
<executeOnParentTaskFailure>true</executeOnParentTaskFailure>
</taskExecutionCondition>
</orchestratedTask>
</orchestratedTasks>

You can then configure the orchestrationTask in EVENT mode with a daily trigger, in the same way as a syncTask.

I hope this answers your question.

Have a nice day.

Best regards,

View original