Continuous color causes error when x or y is factor

When I try to take color from numeric variable and one of the axes is factor, it raises error Error in Summary.factor(...) : ‘range’ not meaningful for factors:

data(mpg)
mpg$classF <- as.factor(mpg$class)

# error when x is factor AND color is numeric:
mpg %>% 
  plot_ly(x = ~classF, y = ~cyl, color = ~displ) %>%
  add_markers()
# Error in Summary.factor(c(2L, 2L, 2L, 2L, 2L, 2L, 2L, 2L, 2L, 2L, 2L,  : 
#                             ‘range’ not meaningful for factors

# works fine when x is character:
mpg %>% 
  plot_ly(x = ~class, y = ~cyl, color = ~displ) %>%
  add_markers()

# also works fine if color is factor or character:
mpg %>% 
  plot_ly(x = ~classF, y = ~cyl, color = ~as.character(displ)) %>%
  add_markers()

Start by running the supplied mpg examples in an R session to reproduce the factor-axis and numeric-color failure. Trace the color handling that calls range on factor data; done means the failing example works without error while the character-axis and factor-or-character-color cases continue to work.