Performance - User defined query / filter to search data

Posted by Cagatay Kalan on Stack Overflow See other posts from Stack Overflow or by Cagatay Kalan
Published on 2010-04-17T16:30:49Z Indexed on 2010/04/17 16:33 UTC
Read the original article Hit count: 327

Filed under:

criteria

|

filter

|

dynamic

|

user-defined

What is the best way to design a system where users can create their own criterias to search data ? By "design" i mean, data storage, data access layer and search structure.

We will actually refactor an existing application which is written in C# and ASP .NET and we don't want to change the infrastructure. Our main issue is performance and we use MSSQL and DevExpress to build queries. Some queries run in 4-5 minutes and all the columns included in the queries have indexes.

When i check queries, i see that DevExpress builds too many "exists" clauses and i'm not happy with that because i have doubts that some of these queries skip some indexes.

What may be the alternatives to DevExpress? NHibernate or Entity Framework? Can we build dynamic criteria system and store these to database in both of them ?

And also do we need any alternative storage like a lucene index or OLAP database?

© Stack Overflow or respective owner

Related posts about criteria

Hibernate Criteria: Add restrictions to Criteria and DetachedCriteria

as seen on Stack Overflow - Search for 'Stack Overflow'
Currently our queries add a variety of Restrictions to ensure the results are considered active or live. These Restrictions are used in several places/queries so a method was setup similar to public Criteria addStandardCriteria(Criteria criteria, ...) { // Add restrictions, create aliases… >>> More
Criteria SpatialRestrictions.IsWithinDistance NHibernate.Spatial

as seen on Stack Overflow - Search for 'Stack Overflow'
Has anyone implemented this, or know if it would be difficult to implement this/have any pointers? public static SpatialRelationCriterion IsWithinDistance(string propertyName, object anotherGeometry, double distance) { // TODO: Implement throw new NotImplementedException(); } from NHibernate… >>> More
Hibernate Criteria query on association

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi There, How would I go about executing the following Hibernate query using the criteria API. I have an object Parent with List children. I would like to search through all parents and find which parents contain a specified child. i.e. List findParent(Child child); Thanks. >>> More
Delete all rows that do not have the value: Criteria 1 or Criteria 2 or Criteria 3 in Column D --> Using VBA Macro for excel

as seen on Stack Overflow - Search for 'Stack Overflow'
I am new to Macro's/VBA and cannot seem to figure out how to do this action for multiple criteria. I am trying to Delete all rows that do not have the value: Identify Fail or Identify Success in Column D. I write the following code and it works for one criteria "Identify Fail": '***********************************************' Sub… >>> More
More than one location provider at same time

as seen on Stack Overflow - Search for 'Stack Overflow'
I have some problems with location systems. I have a service that implements locationlistener. I want to get the best location using network when possible, gps if network is not enough accurate (accuracy greater than 300mt). The problem is this. I need location (accurate if possible, inaccuarte otherways)… >>> More

Related posts about filter

How to filter the jqGrid data NOT using the built in search/filter box

as seen on Stack Overflow - Search for 'Stack Overflow'
I want users to be able to filter grid data without using the intrinsic search box. I have created two input fields for date (from and to) and now need to tell the grid to adopt this as its filter and then to request new data. Forging a server request for grid data (bypassing the grid) and setting… >>> More
PHP Filter, how to filter input array

as seen on Stack Overflow - Search for 'Stack Overflow'
I am using PHP filter to perfom basic sanitization and validation of form data. The principle problem I am having is that I mark my form up so that all the data is in one array for the POST input. e.g. form fields, page[name], page[slug], page[body], page[status], etc. Using the following: filter_input(INPUT_POST… >>> More
Modify the filter chain - Or select servlet to respond to request using filter

as seen on Stack Overflow - Search for 'Stack Overflow'
I am trying to use a filter to map requests. I am trying to do this for two reasons, firstly to dynamically generate URI's and have them mapped to the appropriate servlet and secondly to catch URI's which are not registered and handle them appropriately. So I'm using a catch-all filter to process… >>> More
Capturing and Transforming ASP.NET Output with Response.Filter

as seen on West-Wind - Search for 'West-Wind'
During one of my Handlers and Modules session at DevConnections this week one of the attendees asked a question that I didn’t have an immediate answer for. Basically he wanted to capture response output completely and then apply some filtering to the output – effectively injecting some additional… >>> More
Subterranean IL: Filter exception handlers

as seen on Simple Talk - Search for 'Simple Talk'
Filter handlers are the second type of exception handler that aren't accessible from C#. Unlike the other handler types, which have defined conditions for when the handlers execute, filter lets you use custom logic to determine whether the handler should be run. However, similar to a catch block,… >>> More