Check style found code duplication in factory
I've just got idea how solution should be implemented. It seems stayed clear for me when question was published (this implementation is not best, but idea is pretty good for me). My abstract factory should be replaced with strategy pattern who returns builder that I need.

public EventDto mapToDto(Event googleEvent, EventDto baseEventDto) {
    return getStrategy(googleEvent.getStatus()).mapToDto(googleEvent, baseEventDto);
}

public EventDto mapToDto(Event googleEvent, String originalCalendarId) {
    return getStrategy(googleEvent.getStatus()).mapToDto(googleEvent, originalCalendarId);
}

public GoogleEventDtoMapperAbstract getMappingStrategy(String status) {
    switch (status) {
        case GoogleEventStatus.CANCELLED:
            return googleEventDtoMapperCanceled;
        case GoogleEventStatus.CONFIRMED:
            // will be implemented by needs
        case GoogleEventStatus.TENTATIVE:
            // will be implemented by needs
        default:
            return googleEventDtoMapperConfirmed;
    }
}