I'm using a SDC RPC and I have a question about its working.
Since I'm reading the data source by batch of 1000 records, does the RPC write its output by batch of 1000 records or is it writing record by record ? I guess it use a batch but since it's quite slow, I would like to be sure.
The SDC RPC Destination writes an entire batch of records per HTTP request. The SDC RPC format includes a lot of metadata, so it is slower than other formats. You might want to use JSON or Avro data format if performance is an issue.
How can I use Avro to send data from one sdc to another ? Should I replace SDC RPC ?