Feature #552

Consolidated Search

Added by Andrew Mallis about 1 year ago. Updated 4 months ago.

Status:Closed Start date:04/09/2012
Priority:High Due date:
Assignee:Andrew Mallis % Done:

80%
Category:development Spent time: 5.50 hours
Target version:2.0
Difficulty:advanced

Description

A single search box should be able to locate content by zip/postal code, name, body value, tag, etc.

At this time, the views exposed filter only searches within the title field.

Searches by geographic proximity, keyword, tags, etc seems possible only via solr.

An advanced search page would expose facets more explicitly, so that a user could narrow down the directory result set based on:

  • geography
    • country
    • state/province
    • city
  • select node attributes
    • occupation type
    • active occupation
    • has general assembly
    • founded date
    • has RSS feed
    • has video
    • has twitter

caveats

Search may be impacted by the move to mapbox.

Proximity search can be tricky with address still. See issue queue

use cases

  • As an Unauthenticated User, I want to be able to find Occupations close to my location.
  • As an Unauthenticated User, I want to be able to find Occupations close to an arbitrary location that I type in.

resources

http://evolvingweb.ca/story/building-usable-solr-search-filters-large-drupal-websites
https://wiki.apache.org/solr/PublicServers

Related issues

related to #OWSdirectory - Cosmetic #833: Update Site design/layout Resolved 11/06/2012
related to #OWSdirectory - Feature #1056: Investigate location-based searching with the search_api_... New 01/16/2013
duplicated by #OWSdirectory - Feature #230: Implement proximity-based search via solr Rejected 02/01/2012 02/15/2012
duplicates #OWSdirectory - Cosmetic #1028: Readd view search Closed 11/14/2012

History

#1
Updated by Stephane Corlosquet about 1 year ago

This issue was discussed a while back, but postponed due to the dependency of http://drupal.org/project/search_api and http://drupal.org/project/search_api_solr which itself is not supported yet by pantheon. I'm following the issue which discusses Pantheon integration but it's not ready yet: http://drupal.org/node/1407282

#2
Updated by Stephane Corlosquet about 1 year ago

and I also tried the SQL backend for search_api but it was too flaky.

#3
Updated by Andrew Mallis about 1 year ago

  • Assignee set to Stephane Corlosquet

Indeed, this duplicates issue #230. I'm amending this ticket and going to kill the old one

#4
Updated by Andrew Mallis about 1 year ago

  • Status changed from New to In Progress

http://drupal.org/project/openlayers_solr is another project to look at. Perhaps this will work for us. Might require refactoring our geo model a bit.

#5
Updated by Andrew Mallis 11 months ago

  • Target version changed from 1.0 to 2.0

#6
Updated by Andrew Mallis 10 months ago

  • Assignee deleted (Stephane Corlosquet)
  • Difficulty set to advanced

#7
Updated by Andrew Mallis 10 months ago

installed:

facetapi
search_api
search_api_location
search_api_page
search_api_solr

on dev for experimentation – seems like there's a combination here that will work.

#8
Updated by Andrew Mallis 10 months ago

crap. Looks like

"Pantheon's system is designed to be module-agnostic and we are working on support for search_api, but at this time only the apachesolr.module has the necessary flexibility to use our connection class. Stay tuned for updates on search_api module support."

from: http://helpdesk.getpantheon.com/customer/portal/articles/361249-enabling-solr-search-

#9
Updated by Stephane Corlosquet 10 months ago

yes, see my comment #1, which includes a link to the issue on d.o to follow.

#10
Updated by Andrew Mallis 10 months ago

Stephane Corlosquet wrote:

yes, see my comment #1, which includes a link to the issue on d.o to follow.

looks like there is a little movement https://drupal.org/node/1407282#comment-6262322

#11
Updated by Andrew Mallis 10 months ago

  • % Done changed from 0 to 10

Flipped the search by title for a City search, which is more intuitive and yields better results.
Admin pages also have a "search terms" search, which looks at the whole node.
Not unified or faceted, but definitely better.

Also removed the number of items/page option for regular users, to simplify UI.
Added reset button back in.

#12
Updated by Andrew Mallis 10 months ago

  • Assignee set to Stephane Corlosquet
  • % Done changed from 10 to 20

There is now a patch that can be applied to search api solr in combination with a patch to pantheon_apache_solr.

Matt says the second patch will get rolled in to the Pantheon stack eventually. Safe to apply all this now and move forward, though!

#13
Updated by Andrew Mallis 10 months ago

  • Assignee changed from Stephane Corlosquet to Sam Boyer

Sam, we need your magic gloves and the fingers therein.

#15
Updated by Sam Boyer 7 months ago

i've done the very basics of setup on dev, following the instructions here:

http://helpdesk.getpantheon.com/customer/portal/articles/361249-enabling-solr-search

(if we sync back from live to dev, just follow those steps. all the modules are the correct versions, etc.)

next step is to explore apachesolr_views a bit, see what it gives us. it might not be that hard to do this...

#16
Updated by Stephane Corlosquet 7 months ago

seems like you're going the apachesolr and apachesolr_views route. I've never tried it myself, it was very broken a few months. My 2 cts: don't spend too much time on that combo if it doesn't work, I've found http://drupal.org/project/search_api and http://drupal.org/project/search_api_solr to work well with views for multiple sites I built in the last 6 months, though it wasn't on pantheon (that same docs explain how to set up solr with search api). sorry I don't have much time to help more with this...

#17
Updated by Andrew Mallis 7 months ago

  • Assignee changed from Sam Boyer to Andrew Mallis
  • % Done changed from 20 to 60

Well, I guess it comes back to me…

Got some other help from Jodi Lynn with this @BADCamp and we are now rocking! Like, seriously smokin'.

An unstyled protoype is up on dev, now. A Search page is at http://dev.directory.occupy.net/search and a block with an exposed search field can be included elsewhere on the site and return results to the /search page with facets.

Apache Solr Search, Framework, and views integration are conflicting modules, so these have been scrapped from the stack.

facetapi_select allows us to refine search results so that we can narrow down by city, tag, etc.

search_api_autocomplete isn't in place yet, but I'm working on it. NOT to be confused with apachesolr_autocomplete which isn't the way to go here.

We're building with Search API extensions, not the straight apachesolr companion modules.

search_api_location also looks real promising. We've got it installed, but the schema isn't loaded right now.

Pantheon   Pantheon Apache Solr (pantheon_apachesolr)  Module  Enabled                                                                           
Pantheon   Pantheon Platform API (pantheon_api)   Module  Enabled                  
Search     Search API (search_api)            Module  Enabled        7.x-1.2   
Search     Search views (search_api_views)    Module  Enabled        7.x-1.2   
Search     Solr search (search_api_solr)      Module  Enabled        7.x-1.0-rc2+2-dev  
Search     Search facets (search_api_facetapi) Module  Enabled        7.x-1.2

#18
Updated by Andrew Mallis 6 months ago

The solr behavior is now featurized as directory_solr
The existing search functionality employing views filters has be split out from the base structure feature and rolled into its own feature: directory_views_search.
The old search mode can be re-activated by turing these features on/off.

More expanded views filters are still in use at http://dev.directory.occupy.net/occupations/manage fot the time being, until new management paradigms are developed.

as per this updated post on Pantheon help, we will need to post "schema.xml" to each environment (test, live) at: /admin/config/search/pantheon as well as index, so promoting solr search live will be a little involved.

The search results are still returning the full node, though. The plan is to implement display suite to build out some display modes, so that we can keep our views and search results more easily in line.

#19
Updated by Andrew Mallis 6 months ago

  • Status changed from In Progress to Closed

#20
Updated by Andrew Mallis 4 months ago

  • % Done changed from 60 to 80

A quick note here that the* Pantheon Apache Solr* module must be disabled on a local (kalabox) install but enabled on DEV/TEST?LIVE for the set-up to work properly.

Also available in: Atom PDF