Reading configuration variables in a Python project
Add a declarative format for the config file, possibly. If you encounter errors, the output will look messy today (KeyError is never fun for an end user)
I would say init is a good time, but unclear if it's the right place. It's looking messy. I would either (1) split out parsing the config file into a helper method or (2) consolodate some lines. (1) is better if you expect to add more config.
I would consider making the chrome driver at the start of 'parse', as this is more of a &quot;can fail&quot; type operation--it will make writing tests easier.
Consolidating:

'builder' is used only once, don't declare it
don't assign to self.wanted_organizations_dict, or self.output_path, and self.start_urls twice. just initialize them once, correctly, in one line each.
self.job_highlight_dict is not initialized. i don't know what this is, but are you sure you want to declare it here?
self.CHROME_WEB_DRIVER does not appear to be used outside this, change it to a local variable or inline it, unless you move driver init to parse time
declare self.wanted_organisations_dict in a single-line dict comprehension, not 3 lines.
Initialize chrome_options in a single line, not 4.