From gerv at mozilla.org Mon Nov 4 17:43:39 2002 From: gerv at mozilla.org (Gervase Markham) Date: Mon, 04 Nov 2002 17:43:39 +0000 Subject: [Fwd: Online Help] Message-ID: <3DC6B1CB.8080706@mozilla.org> Anyone got any views on this? I heard nothing when I sent it originally... Gerv -------- Original Message -------- Subject: Online Help Date: Mon, 30 Sep 2002 21:35:53 +0100 From: Gervase Markham Reply-To: developers at bugzilla.org Organization: mozilla.org To: developers at bugzilla.org There's a patch for context-sensitive help over in http://bugzilla.mozilla.org/show_bug.cgi?id=114179 (needs review, if anyone thinks it's worth having) , but this message is more about things like the Bug Writing Guidelines. I produced a patch to make these a page.cgi page (so they got a header, footer etc.) but matty made the point that this stuff should perhaps be in our end-user documentation, which is currently Section 3 of the Bugzilla Guide. So we need to have a discussion about our strategy. There seem to be a couple of routes for page-based help: - page.cgi-based pages. Pros: Bugzilla look and feel Cons: possible duplication of material with that in the Guide - link directly to pages in the Guide Pros: One source for Bugzilla usage information Cons: Possible that manual and online help require different styles Harder to translate Views? Gerv ---- To view or change your list settings, click here: From gerv at mozilla.org Mon Nov 4 17:43:52 2002 From: gerv at mozilla.org (Gervase Markham) Date: Mon, 04 Nov 2002 17:43:52 +0000 Subject: [Fwd: Non-specific templates] Message-ID: <3DC6B1D8.2060303@mozilla.org> Or this one? Gerv -------- Original Message -------- Subject: Non-specific templates Date: Fri, 04 Oct 2002 08:07:53 +0100 From: Gervase Markham Reply-To: developers at bugzilla.org Organization: mozilla.org To: developers at bugzilla.org global/field-descs.html.tmpl contains no output. All it does it define a mapping hash for you. Should it be an "html" template? If not, what ctype should it be using? "xxx"? "none"? Gerv ---- To view or change your list settings, click here: From gerv at mozilla.org Mon Nov 4 18:20:12 2002 From: gerv at mozilla.org (Gervase Markham) Date: Mon, 04 Nov 2002 18:20:12 +0000 Subject: Performance measurements In-Reply-To: References: Message-ID: <3DC6BA5C.5020603@mozilla.org> Bradley Baetz wrote: > When you run teh query from mysql it shows the time taken at the end :) > > I have a script to generate n bugs; I'll tidy it up and attach it this > evening. Ping? :-) Gerv From bbaetz at student.usyd.edu.au Mon Nov 4 22:08:24 2002 From: bbaetz at student.usyd.edu.au (Bradley Baetz) Date: Tue, 5 Nov 2002 09:08:24 +1100 (EST) Subject: Performance measurements In-Reply-To: <3DC6BA5C.5020603@mozilla.org> Message-ID: On Mon, 4 Nov 2002, Gervase Markham wrote: > Bradley Baetz wrote: > > When you run teh query from mysql it shows the time taken at the end :) > > > > I have a script to generate n bugs; I'll tidy it up and attach it this > > evening. > > Ping? :-) Umm, er... Attached. Its not a full schema, but its reasonably easy to extend. Note that I was using the same basic script for pg, too, so it does indiviual INSERTs, which may take quite a while if you make the numbers too big. Thre are a few off-by-one errors in there, but thats not important for our purposes. Bradley -------------- next part -------------- #!/usr/bin/perl -w use strict; my $numUsers = 30000; my $numProducts = 1; my $numBugs = 10000; my $numCcs = 100000; my $numLongDescs = 100000; print "BEGIN;\n"; print "CREATE TABLE profiles ( userid integer NOT NULL auto_increment, login_name varchar(255), PRIMARY KEY (userid) ); "; my %users; foreach my $i (1..$numUsers) { my $username = ''; foreach my $x (1..rand(9)+1) { $username .= chr(65+int(rand(26))); } redo if ($users{$username}); $users{$username} = 1; print "INSERT INTO profiles(login_name) VALUES ('$username');\n"; } print " CREATE UNIQUE INDEX profiles_login_name_idx ON profiles(login_name); "; print "CREATE TABLE products ( id integer NOT NULL auto_increment, name varchar(64) NOT NULL, PRIMARY KEY (id) ); "; my %products; foreach my $i (1..$numProducts) { my $prod = ''; foreach my $x (1..rand(9)+1) { $prod .= chr(65+int(rand(26))); } redo if ($products{$prod}); $products{$prod} = 1; print "INSERT INTO products(name) VALUES ('$prod');\n"; } print " CREATE UNIQUE INDEX products_name_idx ON products(name); "; print "CREATE TABLE bugs ( bug_id integer NOT NULL auto_increment, product_id integer NOT NULL, -- XXX REFERENCES products(id), assigned_to integer NOT NULL, -- REFERENCES profiles(userid), reporter integer NOT NULL, -- REFERENCES profiles(userid), PRIMARY KEY (bug_id) ); "; foreach my $i (1..$numBugs) { print "INSERT INTO bugs(product_id, assigned_to, reporter) VALUES (" . (int(rand($numProducts-1))+1) . "," . (int(rand($numUsers-1)) + 1) . "," . (int(rand($numUsers-1)) + 1) . ");\n"; } print " CREATE INDEX bugs_product_id_idx ON bugs(product_id); CREATE INDEX bugs_assigned_to_idx ON bugs(assigned_to); CREATE INDEX bugs_reporter_idx ON bugs(reporter); "; print "CREATE TABLE cc ( bug_id integer NOT NULL, -- REFERENCES bugs(bug_id), who integer NOT NULL -- REFERENCES profiles(userid) ); "; my %bugs; foreach my $i (1..$numCcs) { my $bug = int(rand($numBugs-1)) + 1; my $user = int(rand($numUsers-1)) + 1; if (defined($bugs{$bug}) && $bugs{$bug}{$user}) { redo; } $bugs{$bug}{$user} = 1; print "INSERT INTO cc(bug_id, who) VALUES ($bug,$user);\n"; } print " CREATE INDEX cc_who_idx ON cc(who); CREATE UNIQUE INDEX cc_bug_id_who_idx ON cc(bug_id,who); "; print "CREATE TABLE longdescs ( bug_id integer NOT NULL, -- REFERENCES bugs(bug_id), who integer NOT NULL -- REFERENCES profiles(userid) ); "; foreach my $i (1..$numLongDescs) { my $bug = int(rand($numBugs-1)) + 1; my $user = int(rand($numUsers-1)) + 1; print "INSERT INTO longdescs(bug_id, who) VALUES ($bug,$user);\n"; } print " CREATE INDEX longdescs_bug_id_idx ON longdescs(bug_id); CREATE INDEX longdescs_who_idx ON longdescs(who); "; print "COMMIT;\n"; From matthew at barnson.org Tue Nov 5 01:59:51 2002 From: matthew at barnson.org (Matthew P. Barnson) Date: 04 Nov 2002 18:59:51 -0700 Subject: [Fwd: Online Help] In-Reply-To: <3DC6B1CB.8080706@mozilla.org> References: <3DC6B1CB.8080706@mozilla.org> Message-ID: <1036461591.2170.20.camel@chandler.int.barnson.org> On Mon, 2002-11-04 at 10:43, Gervase Markham wrote: > Anyone got any views on this? I heard nothing when I sent it originally... > - page.cgi-based pages. > Pros: Bugzilla look and feel > Cons: possible duplication of material with that in the Guide I'd be against this sort of approach... duplication of effort is needless. > - link directly to pages in the Guide > Pros: One source for Bugzilla usage information > Cons: Possible that manual and online help require different styles > Harder to translate I'd be all for this kind of approach. The important thing is to figure out the context-sensitive portions that the Guide could have links for. Hmm, that didn't come out well. I mean, KDE and Gnome both use this type of help system, where in the well-written products, clicking "help" at a particular part takes you to the help screen for the menu/dropdown/what-have-you that you're at. You can also read the help end-to-end. It would require a bit more of a screen-based approach to the User's Guide portion of The Bugzilla Guide, but would be quite do-able IMHO, and probably more readable than what we have now. -- Matthew P. Barnson Sr. UNIX Systems Administrator DAM Computer Consulting, Inc. "When you cuss, think of us!" "...the general idea that [the Supreme Court ]will restrain itself, despite believing a law is stupid, is a feature, not a bug in our constitutional tradition." -Lawrence Lessig nd 100%". --Penn Jillette one and drive on without guilt! -ccm From gerv at mozilla.org Tue Nov 5 09:37:50 2002 From: gerv at mozilla.org (Gervase Markham) Date: Tue, 05 Nov 2002 09:37:50 +0000 Subject: [Fwd: Online Help] In-Reply-To: <1036461591.2170.20.camel@chandler.int.barnson.org> References: <3DC6B1CB.8080706@mozilla.org> <1036461591.2170.20.camel@chandler.int.barnson.org> Message-ID: <3DC7916E.9010809@mozilla.org> Matthew P. Barnson wrote: > On Mon, 2002-11-04 at 10:43, Gervase Markham wrote: >>- link directly to pages in the Guide >> Pros: One source for Bugzilla usage information >> Cons: Possible that manual and online help require different styles >> Harder to translate > > I'd be all for this kind of approach. So how would you solve the localisation problem? Gerv From bbaetz at student.usyd.edu.au Tue Nov 5 23:19:03 2002 From: bbaetz at student.usyd.edu.au (Bradley Baetz) Date: Wed, 6 Nov 2002 10:19:03 +1100 (EST) Subject: You may want to upgrade TT... Message-ID: Theres now a development v 2.08c of template toolkit. This works arround a perl bug exposed via the recent update to CGI.pm, where error messages would end up being reported as "Template::Exception" rather than anything useful. Gerv was finding this really annoying, in particular :) It will also provide a speedup to people running v2.08, since File::Temp will then become lazily loaded, and Bugzila doesn't usually use that part of TT toolkit. This was first used in v2.08, so theres no difference from earlier releases of TT. Theres no need to do this in checksetup, and up the formal version requirements, since it really only affects developers. We can reconsider once a stable 2.09 release comes out (because of the speed thing). Bradley From myk at mozilla.org Tue Nov 5 23:34:26 2002 From: myk at mozilla.org (Myk Melez) Date: Tue, 05 Nov 2002 15:34:26 -0800 Subject: You may want to upgrade TT... In-Reply-To: References: Message-ID: <3DC85582.5050401@mozilla.org> Bradley Baetz wrote: >Theres now a development v 2.08c of template toolkit. This works arround a >perl bug exposed via the recent update to CGI.pm, where error messages >would end up being reported as "Template::Exception" rather than anything >useful. Gerv was finding this really annoying, in particular :) > Any idea what the fix for that looks like? I might prefer to patch my current 2.07 installation, since upgrading TT means porting my FLUSH patch, which may not be easy. From bbaetz at student.usyd.edu.au Tue Nov 5 23:45:01 2002 From: bbaetz at student.usyd.edu.au (Bradley Baetz) Date: Wed, 6 Nov 2002 10:45:01 +1100 (EST) Subject: You may want to upgrade TT... In-Reply-To: <3DC85582.5050401@mozilla.org> Message-ID: On Tue, 5 Nov 2002, Myk Melez wrote: > Bradley Baetz wrote: > > >Theres now a development v 2.08c of template toolkit. This works arround a > >perl bug exposed via the recent update to CGI.pm, where error messages > >would end up being reported as "Template::Exception" rather than anything > >useful. Gerv was finding this really annoying, in particular :) > > > Any idea what the fix for that looks like? I might prefer to patch my > current 2.07 installation, since upgrading TT means porting my FLUSH > patch, which may not be easy. Yeah, its in the archives at http://www.template-toolkit.org/pipermail/templates/2002-October/003779.html although its been base64 encoded by my mailer. I generated it with a perl script + manual corrections. I can mail you a copy if you want. You're going to have to update eventually, though, since 2.08 will become a requirement fairly soon. I don't think that there are likly to be major changes which would have affected that patch, though. Bradley From matthew at barnson.org Wed Nov 6 03:10:40 2002 From: matthew at barnson.org (Matthew P. Barnson) Date: 05 Nov 2002 20:10:40 -0700 Subject: [Fwd: Online Help] In-Reply-To: <3DC7916E.9010809@mozilla.org> References: <3DC6B1CB.8080706@mozilla.org> <1036461591.2170.20.camel@chandler.int.barnson.org> <3DC7916E.9010809@mozilla.org> Message-ID: <1036552240.2801.297.camel@chandler.int.barnson.org> Well, I hadn't really given that much thought, but it looks like the KDE guys have already figured this out. http://i18n.kde.org/translation-howto/index.php . It seems to be a pretty comprehensive how-to, and I don't think we'd go wrong emulating it, since the standards involved are fairly universal and becoming better understood in the UNIX community these days. Basically, if I understand correctly, we need to generate "empty" files which contain the bare structure of the Guide for translations. These "empty" files are actually skeletal Docbook XML with no textual data between the tags. Apparently, you can merge these "PO's" with the master "POT" when the master (English) version of the Guide is updated, so that translators end up with "fuzzy" areas on their translation, with English words in there temporarily that need to be translated. I'm not certain what to do about the section id links and other xreflabels and such that give clues to locations of things in the documentation. I'm thinking we should probably stick to the English definition of the link, but make sure that the entire text is UTF-8 encoded. Although I'm really not even sure what that means at this point, I'm sure I can figure it out :) We probably want to put in a skeleton structure for translations we're going to attempt first. Although my German is quite rusty, after I reorganize the doc, I'll be happy to begin translation efforts. The translation will be so bad that I am sure a native German speaker will desparately want to correct it. I suggest we use ISO3166-1 codes, like this: bugzilla/en/docs/sgml (or html, or txt, whatever) bugzilla/de/docs/sgml bugzilla/pt/docs/sgml (Portugal Portuguese translation) bugzilla/br/docs/sgml (Brazilian Portuguese translation) etc. What would really be the cat's meow would be to have the country code be *before* the Bugzilla path, so that we can indicate an entire localized tree: en/bugzilla/docs/sgml de/bugzilla/docs/sgml etc. That would make it easier on the linking for the app, so we don't have to have logic in the app with a param saying "please enter your two-letter ISO3166 country code here". Although, IMHO, that would be an acceptable parameter if we don't want to have separate localized versions of the app... On Tue, 2002-11-05 at 02:37, Gervase Markham wrote: > So how would you solve the localisation problem? -- Matthew P. Barnson Sr. UNIX Systems Administrator DAM Computer Consulting, Inc. "When you cuss, think of us!" "...the general idea that [the Supreme Court ]will restrain itself, despite believing a law is stupid, is a feature, not a bug in our constitutional tradition." -Lawrence Lessig nd 100%". --Penn Jillette one and drive on without guilt! -ccm From gerv at mozilla.org Tue Nov 5 08:31:48 2002 From: gerv at mozilla.org (Gervase Markham) Date: Tue, 05 Nov 2002 08:31:48 +0000 Subject: For interest: Bugzilla performance Message-ID: <3DC781F4.1000605@mozilla.org> As you may recall, I made some changes to the default params on the Bugzilla Search UI two weeks ago. Specifically, I changed: - The default for email addresses to "is" rather than "contains", and - The default for comments search to "contains string" rather than "contains all words/strings" I get email from Bugzilla whenever a search is killed for taking too long. The number of these mails, while fluctuating a lot, is therefore a crude measure of how overloaded Bugzilla is. Here are the averages, for the interest of staff@ and developers at . Pre-changes: 45.9 mails per day over 7 days Post-changes: 16.3 mails per day over 12 days Further performance changes, which required changes to Bugzilla's code, will kick in at the upgrade on November 8th. Gerv From myk at mozilla.org Wed Nov 6 09:32:19 2002 From: myk at mozilla.org (Myk Melez) Date: Wed, 06 Nov 2002 01:32:19 -0800 Subject: For interest: Bugzilla performance In-Reply-To: <3DC781F4.1000605@mozilla.org> References: <3DC781F4.1000605@mozilla.org> Message-ID: <3DC8E1A3.2020306@mozilla.org> Gervase Markham wrote: > Pre-changes: 45.9 mails per day over 7 days > Post-changes: 16.3 mails per day over 12 days Note that the number of killed queries varies widely by day of week (f.e. there were 6 on Sunday, 17 on Monday, and 50 on Tuesday), so measuring two different time periods is likely to throw off the data. Note also that emails sometimes mention multiple killed queries, especially when the queries are generated by a DOS attack. We stopped a DOS attack last Wednesday evening, not the first we've dealt with in the last month, and that may have skewn results both before and afterwards. Still I'm quite happy about these changes, which I think have improved performance. > Further performance changes, which required changes to Bugzilla's > code, will kick in at the upgrade on November 8th. Unfortunately we'll inherit some performance regressions as well from some recent code changes (the groups rewrite in particular) that the performance improvements will hopefully counteract. -myk From gerv at mozilla.org Wed Nov 6 09:48:54 2002 From: gerv at mozilla.org (Gervase Markham) Date: Wed, 06 Nov 2002 09:48:54 +0000 Subject: For interest: Bugzilla performance In-Reply-To: <3DC8E1A3.2020306@mozilla.org> References: <3DC781F4.1000605@mozilla.org> <3DC8E1A3.2020306@mozilla.org> Message-ID: <3DC8E586.2030302@mozilla.org> Myk Melez wrote: > Gervase Markham wrote: > >> Pre-changes: 45.9 mails per day over 7 days >> Post-changes: 16.3 mails per day over 12 days > > Note that the number of killed queries varies widely by day of week > (f.e. there were 6 on Sunday, 17 on Monday, and 50 on Tuesday), so > measuring two different time periods is likely to throw off the data. I hoped to counteract this problem by averaging. The second twelve days followed on from the first seven, so (roughly) we have a single week average, then a following two-week average. > Note also that emails sometimes mention multiple killed queries, > especially when the queries are generated by a DOS attack. This is also true, and I made no attempt to count this. I assumed, perhaps incorrectly, that this would not affect one set of results any more than another. > We stopped a DOS attack last Wednesday evening, not the first we've > dealt with in the last month, and that may have skewn results both > before and afterwards. If you exclude last Wednesday from the results (65 mails), then that 16.3 figure goes down to 11.9, making the improvement greater. >> Further performance changes, which required changes to Bugzilla's >> code, will kick in at the upgrade on November 8th. > > Unfortunately we'll inherit some performance regressions as well from > some recent code changes (the groups rewrite in particular) that the > performance improvements will hopefully counteract. Indeed. It's all swings and roundabouts. Gerv From myk at mozilla.org Wed Nov 6 11:00:46 2002 From: myk at mozilla.org (Myk Melez) Date: Wed, 06 Nov 2002 03:00:46 -0800 Subject: For interest: Bugzilla performance In-Reply-To: <3DC781F4.1000605@mozilla.org> References: <3DC781F4.1000605@mozilla.org> <3DC8E1A3.2020306@mozilla.org> <3DC8E586.2030302@mozilla.org> Message-ID: <3DC8F65E.9010504@mozilla.org> Gervase Markham wrote: > If you exclude last Wednesday from the results (65 mails), then that > 16.3 figure goes down to 11.9, making the improvement greater. I count 39 from last Wedneday (the difference is probably due to email client time localizations) and 98 mails in the last six days (Thursday, October 31 - Tuesday, November 5), which compares to: 40 emails from Thursday, October 3 - Tuesday, October 8 98 emails from Thursday, October 10 - Tuesday, October 15 312 emails from Thursday, October 17 - Tuesday, October 22 117 emails from Thursday, October 24 - Tuesday, October 29 Of these result sets, I believe only the latter two are influenced by your changes, and they do show a downward trend, but the overall results are too variable to be indicative. This may be because of DOS attacks (intentional or otherwise), but it could also be natural volatility in Bugzilla usage. -myk From bbaetz at student.usyd.edu.au Wed Nov 6 12:41:12 2002 From: bbaetz at student.usyd.edu.au (Bradley Baetz) Date: Wed, 6 Nov 2002 23:41:12 +1100 (EST) Subject: For interest: Bugzilla performance In-Reply-To: <3DC8E1A3.2020306@mozilla.org> Message-ID: On Wed, 6 Nov 2002, Myk Melez wrote: > Note also that emails sometimes mention multiple killed queries, > especially when the queries are generated by a DOS attack. > > We stopped a DOS attack last Wednesday evening, not the first we've > dealt with in the last month, and that may have skewn results both > before and afterwards. Potential project for interested people - hack mod_throttle to allow whitelisting ip blocks ;) (Does mod_throttle catch anyone anymore, since the limit was raised to deal with NSCP's NATed connections?) > Unfortunately we'll inherit some performance regressions as well from > some recent code changes (the groups rewrite in particular) that the > performance improvements will hopefully counteract. Yeah. Unfortunately, there was no working arround that one - a bitwise AND is always going to be quicker than an sql table join, no matter how you write the query. It has given us some nice features, although Joel's stuff isn't landing before bmo's upgrade, so most of the advantages are only infrastructure related. (The timing you did yesterday was on the whole script, mind you, not just on the sql, so its possible, although unlikely, that something else slowed down. We should test that at some point) Bring on mod_perl! ;) > -myk Bradley From myk at mozilla.org Wed Nov 6 12:47:36 2002 From: myk at mozilla.org (Myk Melez) Date: Wed, 06 Nov 2002 04:47:36 -0800 Subject: For interest: Bugzilla performance In-Reply-To: References: Message-ID: <3DC90F68.2050101@mozilla.org> Bradley Baetz wrote: >On Wed, 6 Nov 2002, Myk Melez wrote: > > > >>Note also that emails sometimes mention multiple killed queries, >>especially when the queries are generated by a DOS attack. >> >>We stopped a DOS attack last Wednesday evening, not the first we've >>dealt with in the last month, and that may have skewn results both >>before and afterwards. >> >> > >Potential project for interested people - hack mod_throttle to allow >whitelisting ip blocks ;) (Does mod_throttle catch anyone anymore, since >the limit was raised to deal with NSCP's NATed connections?) > No, mod_throttle is now completely ineffective, since Netscape NATs everyone coming through the firewall to a single IP address. I asked the author of mod_throttle about whitelisting, and he said it'll happen in versioni 4, due out sometime (this seemed to be later than sooner). Fortunately, however, John Dee has agreed to work on a script that accomplishes what mod_throttle does except that it creates permanent bans and honors a whitelist, so we should have better defenses against these attacks soon. -myk From bbaetz at student.usyd.edu.au Wed Nov 6 13:13:18 2002 From: bbaetz at student.usyd.edu.au (Bradley Baetz) Date: Thu, 7 Nov 2002 00:13:18 +1100 (EST) Subject: For interest: Bugzilla performance In-Reply-To: <3DC90F68.2050101@mozilla.org> Message-ID: On Wed, 6 Nov 2002, Myk Melez wrote: > No, mod_throttle is now completely ineffective, since Netscape NATs > everyone coming through the firewall to a single IP address. I asked > the author of mod_throttle about whitelisting, and he said it'll happen > in versioni 4, due out sometime (this seemed to be later than sooner). Right, hence the 'potential project'... Actually, all the NSCP stuff is in one subnet, right? Can't you manually hack the mod_throttle source for your specific needs? /me grabs source code: in mod_throttle's access_handler, just before grabbing the critical section, if r->connection->remote_addr.sin_addr is in an NSCP/AOL subnet, then return DECLINED. Totally and utterly untested, mind you - if it breaks you get to keep the pieces :) Bradley From gerv at mozilla.org Wed Nov 6 14:23:58 2002 From: gerv at mozilla.org (Gervase Markham) Date: Wed, 06 Nov 2002 14:23:58 +0000 Subject: For interest: Bugzilla performance In-Reply-To: <3DC8F65E.9010504@mozilla.org> References: <3DC781F4.1000605@mozilla.org> <3DC8E1A3.2020306@mozilla.org> <3DC8E586.2030302@mozilla.org> <3DC8F65E.9010504@mozilla.org> Message-ID: <3DC925FE.80002@mozilla.org> Myk Melez wrote: > Of these result sets, I believe only the latter two are influenced by > your changes, and they do show a downward trend, but the overall results > are too variable to be indicative. This may be because of DOS attacks > (intentional or otherwise), but it could also be natural volatility in > Bugzilla usage. You have a larger archive than me :-) I didn't realise the volume was so low earlier in the month, nor that the week-on-week average was so volatile. The change was made on Wednesday, 23rd October. Fair enough, then. We can't really tell if it made a difference. One thing that is true, though, is that reading the killed searches, there are less of the sort (lots of words in the comments, email substrings) that the changes were designed to prevent. But I suppose that's obvious. Gerv From gerv at mozilla.org Wed Nov 6 15:59:38 2002 From: gerv at mozilla.org (Gervase Markham) Date: Wed, 06 Nov 2002 15:59:38 +0000 Subject: Festa's CNET article on 200,000 bug sweepstake Message-ID: <3DC93C6A.6060805@mozilla.org> http://news.com.com/2100-1023-964663.html?tag=fd_top We got off pretty lightly :-) I sent info to Catherine, and she provided Paul with the quote he used. CCing developers at bugzilla.org because Bugzilla gets a good plug at the end of this article. Gerv From douglas at SLAC.Stanford.EDU Fri Nov 8 00:24:00 2002 From: douglas at SLAC.Stanford.EDU (Douglas Smith) Date: Thu, 07 Nov 2002 16:24:00 -0800 Subject: Hello all- Message-ID: <200211071624.00045.douglas@slac.stanford.edu> I am new to development for bugzilla, and we are eval it to be used for BaBar high energy experiment for bug tracking with our software. There are a few concerns I have - 1. Is there standard way to produce/view debug messages in developing/changing the code? 2. Can I get the user authentication to use the Apache server authentication, instead of the interal bugzilla login? And if I do get this to work, and people interested in my changes for a later version (I might be a little rough on this to get it working quickly). 3. We have ~1200 software packages to manage, I am assuming that I can't (or shouldn't) create 1200 products in BugZilla, any suggestions on how I should split these up, or is there a limit (suggested or managable) on the number of components in each product? 4. Support for Oracle in the works? Perhaps I can help with this? Douglas -- ----------------------------------------------------------- Douglas A. Smith douglas at slac.stanford.edu Office: Bld 280, Rm 157 (650)926-2369 ----------------------------------------------------------- From justdave at syndicomm.com Fri Nov 8 01:06:14 2002 From: justdave at syndicomm.com (David Miller) Date: Thu, 7 Nov 2002 20:06:14 -0500 Subject: Hello all- In-Reply-To: <200211071624.00045.douglas@slac.stanford.edu> References: <200211071624.00045.douglas@slac.stanford.edu> Message-ID: On 11/7/02 4:24 PM -0800, Douglas Smith wrote: > 2. Can I get the user authentication to use the Apache server > authentication, instead of the interal bugzilla login? > And if I do get this to work, and people interested in my > changes for a later version (I might be a little rough on > this to get it working quickly). This has been attempted once or twice... there's advantages and drawbacks to it. See http://bugzilla.mozilla.org/show_bug.cgi?id=166794, which I'm pretty sure is a dupe, because I know there's another bug with a ton more discussion on it, but I can't find it right now. The above bug will get duped to it when I find it. > 3. We have ~1200 software packages to manage, I am assuming > that I can't (or shouldn't) create 1200 products in BugZilla, > any suggestions on how I should split these up, or is there > a limit (suggested or managable) on the number of components > in each product? You can have as many products as you want up to the limits of the database's key size, and ditto for components. I think you can have a total of 32767 products, and the same number of components (total components, not per product). You may want a better way of breaking them up on the "choose a product" page though when you go into Enter Bug. I have one I'm working on right now that has a list-box with the products instead of just listing them all on the page, and the description on the right changes via javascript based on which one you have selected. (Look at the Bugzilla Helper on bugzilla.mozilla.org for an example of this - their Choose-component section within the guided bug form uses the same code) > 4. Support for Oracle in the works? Perhaps I can help with > this? It's been done in the past, a LONG time ago. I wouldn't argue against it happening again, and I'll likely help with it if it does. I'm in the process of making it work with Sybase right now, and Dave Lawrence is working on support for Postgres. Both of those will likely be done in the next month or two. (Postgres is almost done now, but Dave Lawrence is out travelling the country in an RV promoting Red Hat right now :) -- Dave Miller Project Leader, Bugzilla Bug Tracking System http://www.justdave.net/ http://www.bugzilla.org/ From myk at mozilla.org Fri Nov 8 04:55:27 2002 From: myk at mozilla.org (Myk Melez) Date: Thu, 07 Nov 2002 20:55:27 -0800 Subject: thanks for help on b.m.o upgrade and things still to do Message-ID: <3DCB43BF.3020601@mozilla.org> Hey everyone, Thanks for all your help getting the Bugzilla trunk ready for the b.m.o upgrade (and developer's release)! In the last few days a number of folks have pitched in with patches, reviews, testing, advice, and other help, and I appreciate it very much. It has already contributed to making this upgrade smoother than previous ones. There are still a few things to do and not much time to do them. If you have some time, please pitch in. The following bugs (in order of importance from most to least) need review: 178841 - confidential bug; email me if you want to help review and aren't in the security group 171505 - disabled flags should still show up in the UI In addition, the following two bugs aren't on the blocker list, but they are low risk and small and ripe for adding (if the two bugs above get resolved quickly): bug 170464 - OS/2 disappeared from operating system list (Bugzilla Helper) bug 178984 - flag requestee field should be disabled unless flag is requested If more bugs pop up in the next day I'll link to them from the b.m.o upgrade bug: http://bugzilla.mozilla.org/show_bug.cgi?id=bmo-upgrade If you see a bug that should be in the upgrade, tell me why in a comment on the upgrade bug, but note that only security vulnerabilities, serious bustage, significant performance improvements, and extremely low-risk UI enhancements will get into the upgrade at this late stage. Also note that Dave has the final say on what goes into the developer's release (and thus, the b.m.o upgrade), but I think he's following my lead on things (at least until after the upgrade). You need to get a=justdave on all bugs at this point before checking in a fix for them. One more thing! If you're responsible for a feature that landed since the last b.m.o upgrade on July 11, it would really help if you wrote up a small blurb about the feature, how it works, and how to use it. I'll use your blurb in an email to the mozilla.org community about the upgrade on Monday, and I'll pass it along to Dave for use in the release notes and publicity for the developer's release. -myk From gerv at mozilla.org Fri Nov 8 09:27:31 2002 From: gerv at mozilla.org (Gervase Markham) Date: Fri, 08 Nov 2002 09:27:31 +0000 Subject: Hello all- In-Reply-To: <200211071624.00045.douglas@slac.stanford.edu> References: <200211071624.00045.douglas@slac.stanford.edu> Message-ID: <3DCB8383.1070300@mozilla.org> Douglas Smith wrote: > I am new to development for bugzilla, and we are eval it > to be used for BaBar high energy experiment for bug tracking > with our software. > > There are a few concerns I have - In the future, the newsgroup is probably a better place to ask such questions. :-) > 1. Is there standard way to produce/view debug messages in > developing/changing the code? If it goes wrong, see the Apache error log. :-) Gerv From gerv at mozilla.org Fri Nov 8 18:39:57 2002 From: gerv at mozilla.org (Gervase Markham) Date: Fri, 08 Nov 2002 18:39:57 +0000 Subject: [Fwd: Online Help] In-Reply-To: <1036552240.2801.297.camel@chandler.int.barnson.org> References: <3DC6B1CB.8080706@mozilla.org> <1036461591.2170.20.camel@chandler.int.barnson.org> <3DC7916E.9010809@mozilla.org> <1036552240.2801.297.camel@chandler.int.barnson.org> Message-ID: <3DCC04FD.9010307@mozilla.org> Matthew P. Barnson wrote: > Well, I hadn't really given that much thought, but it looks like the KDE > guys have already figured this out. > http://i18n.kde.org/translation-howto/index.php . It seems to be a > pretty comprehensive how-to, and I don't think we'd go wrong emulating > it, since the standards involved are fairly universal and becoming > better understood in the UNIX community these days. > > Basically, if I understand correctly, we need to generate "empty" files > which contain the bare structure of the Guide for translations. The problem with this approach is that we then have two different translation mechanisms. I think it's fair to say that translators will not want to bother with 90% of content in the Bugzilla Guide - the admin either speaks English, or knows someone who does. More important is interface localisation (for which we already have a mechanism) and localisation of help. Now, it's my assertion that the in-app help for Bugzilla is a different thing to the user section of the Bugzilla Guide, and that even if they share concepts, the text of one would not be suitable for direct use in the other. I believe it would be easier all round if we use the normal Bugzilla localisation mechanism for all of Bugzilla, including its help. Then, if someone turns up with a completely translated Guide, we can cross that bridge at that point. Gerv From myk at mozilla.org Sat Nov 9 14:13:47 2002 From: myk at mozilla.org (Myk Melez) Date: Sat, 09 Nov 2002 06:13:47 -0800 Subject: b.m.o upgrade complete; regression fixing underway Message-ID: <3DCD181B.7060106@mozilla.org> The b.m.o upgrade took a little over seven hours. I brought the system back up after 1am Friday night/Saturday morning. The bad news is that we quickly found a bunch of regressions. The good news is that so far all of them have been either minor or obvious (or in some cases both). We have no known data loss/corruption bugs and only one (potential) security hole. Thanks to everyone who stayed up or woke up around the world to help out with the regression fixing and reviewing! Got a second? Take a look at the list and pick off one or two to fix or review: http://bugzilla.mozilla.org/show_bug.cgi?id=bmo-regressions /me goes to get some sleep -myk From gerv at gerv.net Fri Nov 15 09:33:40 2002 From: gerv at gerv.net (Gervase Markham) Date: Fri, 15 Nov 2002 09:33:40 +0000 Subject: Bugzilla bug tracking database for 2.5 now available. Message-ID: <3DD4BF74.7060808@gerv.net> Martin, I'm one of the core developers of Bugzilla, and just wanted to say how great it is that you've started using it for the Linux kernel (http://bugme.osdl.org/). Might I suggest you set up a product (or component) for people to file bugs against your Bugzilla installation in? This allows you to triage them, separate out local tweak requests from more general enhancements, and forward the latter on to us in http://bugzilla.mozilla.org :-) You might even use Bugzilla's bug moving feature for this purpose. Also, are you aware of the news://news.mozilla.org/netscape.public.mozilla.webtools newsgroup? It's the best place for Bugzilla advice. Particularly, I'd suggest you run ideas past it before implementing any sigificant changes or enhancements - not because you are incapable (perish the thought), but merely because we've found in the past that people who don't, normally do things the obvious and hard, rather than the less-obvious and easy way :-) Good luck, and let us know if there's anything we can do to help. We love to get feedback on how we can make Bugzilla better. Gerv From bbaetz at student.usyd.edu.au Fri Nov 15 10:56:57 2002 From: bbaetz at student.usyd.edu.au (Bradley Baetz) Date: Fri, 15 Nov 2002 21:56:57 +1100 Subject: Why quicksearch sucks Message-ID: <20021115105657.GA15966@tomato.home> As you've probably noticed, quicksearch has been disabled on bmo due to load issues. This is bug 179960. The main problem is that quicksearch entries are inherently slow. We do a substring search on the description OR status whiteboard for each word. This means that the best we can get away with is a linear search of all the bug in teh database. However, we also do a substring match on the product/components. Before the upgrade, this was just an extra string search. After the upgrade + bug 43600, this is now a string search on the product/component table, and an integer equality test on teh bugs table, via a JOIN/ Now, you'd think that that would be faster - comparing a number has to beat a string subsearch on each bug entry. The problem is that QS uses OR between items, so the database cannot use the product/component stuff as a filter to start with. Instead, rather than the 'simple' traversal of all the entries, because this is a join the db has to use a separate table, to create the rows containt the bugs, product, _and_ component entries. This table ends up having to be on disk for our 180000-odd bugs, which is real slow. This is basically the same problem as bug 127200, I think. So, how do we fix it? The correct fix is to use a subselect for the product id: SELECT ... FROM bugs WHERE bugs.product_id IN (SELECT id FROM products WHERE (instr(products.name, 'foo')))) OR ... OR instr(bugs.short_desc, "foo")) That then gets us back to the previous search, but probably slightly faster because of the number checks. Which is great, except that mysql doesn't support SUBSELECTs. So the alternate solution is to do what was done in bug 21700, and lookup stuff in joined tables first. I wasnt to do this via some sort of warpper func which would use subselects for database servers, and a separate select + IN for mysql. There are a couple of disadvantages with this: - the routine we use will be messy - for small matches, (not using OR), this may be slower, because of the extra perl<->db overhead - for really large matches, this may be slower, not only because of the overhead, but because matching most of the db will require the temp table anyway. Also: - &debug=1 output won't show the full query. Tough. :) - Bugzilla::Search won't really be abel to give you back the SQL per se; it'd have to change to a ->runQuery method. Its probably going to have to do that for other reasons, though, so thats not an issue. I'm not sure how much the last two will affect things; the second isn't the common case, and we really shouldn't be tuning to people seecting > 50000 bugs. The first is unlikly to be much - even if its (say) 20% (which its not on localhost, but could be if your db server was a long way away), 120% of 0.01 seconds isn't going to be noticable by anyone, and it smore than balanced out by teh cases where it would matter. There are issues with the max size for an IN; we can fix that by breaking it up into subsections and then using OR on the bits. Note that when we move to custfields, we'll have exactly the same problem, so we do need a generic solution to this. Thoughts? Bradley From kniht at us.ibm.com Fri Nov 15 17:24:28 2002 From: kniht at us.ibm.com (Jon Tollefson) Date: 15 Nov 2002 11:24:28 -0600 Subject: Bugzilla bug tracking database for 2.5 now available. In-Reply-To: <443986008.1037346905@[10.10.2.3]> References: <3DD4BF74.7060808@gerv.net> <443986008.1037346905@[10.10.2.3]> Message-ID: <1037381068.6872.158.camel@skynet.rchland.ibm.com> On Fri, 2002-11-15 at 09:55, Martin J. Bligh wrote: > > I'm one of the core developers of Bugzilla, and just wanted to > > say how great it is that you've started using it for the Linux > > kernel (http://bugme.osdl.org/). > > Thanks - there's actually a small team of people here doing it, > I'm just a rabble-rouser for interfacing with the Linux community, > Jon (cc'ed) is doing the hard work of configuring Bugzilla. > > > Might I suggest you set up a product (or component) for people > > to file bugs against your Bugzilla installation in? This allows > > you to triage them, separate out local tweak requests from more > > general enhancements, and forward the latter on to us in > > http://bugzilla.mozilla.org :-) You might even use Bugzilla's > > bug moving feature for this purpose. > > We did discuss creating such a category already, not sure where > that was at ... we'll probably need one eventually. The config is > still fairly embryonic at this stage - made more sense to just do > something basic, and push it out there to see what else it needed. > I am thinking that would be a good idea. It would probably just be a single component for bugzilla; not wanting to distract too much from the main purpose of the server (to track Linux bugs). > > Also, are you aware of the news://news.mozilla.org/netscape.public.mozilla.webtools newsgroup? > > It's the best place for Bugzilla advice. Particularly, I'd suggest > > you run ideas past it before implementing any sigificant changes or > > enhancements - not because you are incapable (perish the thought), > > but merely because we've found in the past that people who don't, > > normally do things the obvious and hard, rather than the > > less-obvious and asy way :-) > > Nah, I actually am fairly incapable at this sort of thing ;-) > But Jon isn't ... he'll do all that stuff, so he'll probably contact > you directly. We want to do something wacky with versions for > instance, if we can't see an obvious way, that might be a good thing > to start with. > > > Good luck, and let us know if there's anything we can do to help. > > We love to get feedback on how we can make Bugzilla better. > > Thanks for the support, > > M. Thanks for the information and support. I have been following that news group though I haven't post there much. I am normally on the #mozwebtools irc channel too, but have been a fairly quiet guy. I will try to open up more :) Jon From mbligh at aracnet.com Fri Nov 15 15:55:08 2002 From: mbligh at aracnet.com (Martin J. Bligh) Date: Fri, 15 Nov 2002 07:55:08 -0800 Subject: Bugzilla bug tracking database for 2.5 now available. In-Reply-To: <3DD4BF74.7060808@gerv.net> References: <3DD4BF74.7060808@gerv.net> Message-ID: <443986008.1037346905@[10.10.2.3]> > I'm one of the core developers of Bugzilla, and just wanted to > say how great it is that you've started using it for the Linux > kernel (http://bugme.osdl.org/). Thanks - there's actually a small team of people here doing it, I'm just a rabble-rouser for interfacing with the Linux community, Jon (cc'ed) is doing the hard work of configuring Bugzilla. > Might I suggest you set up a product (or component) for people > to file bugs against your Bugzilla installation in? This allows > you to triage them, separate out local tweak requests from more > general enhancements, and forward the latter on to us in > http://bugzilla.mozilla.org :-) You might even use Bugzilla's > bug moving feature for this purpose. We did discuss creating such a category already, not sure where that was at ... we'll probably need one eventually. The config is still fairly embryonic at this stage - made more sense to just do something basic, and push it out there to see what else it needed. > Also, are you aware of the news://news.mozilla.org/netscape.public.mozilla.webtools newsgroup? > It's the best place for Bugzilla advice. Particularly, I'd suggest > you run ideas past it before implementing any sigificant changes or > enhancements - not because you are incapable (perish the thought), > but merely because we've found in the past that people who don't, > normally do things the obvious and hard, rather than the > less-obvious and asy way :-) Nah, I actually am fairly incapable at this sort of thing ;-) But Jon isn't ... he'll do all that stuff, so he'll probably contact you directly. We want to do something wacky with versions for instance, if we can't see an obvious way, that might be a good thing to start with. > Good luck, and let us know if there's anything we can do to help. > We love to get feedback on how we can make Bugzilla better. Thanks for the support, M. From afranke at ags.uni-sb.de Sat Nov 16 05:04:56 2002 From: afranke at ags.uni-sb.de (Andreas Franke) Date: Sat, 16 Nov 2002 06:04:56 +0100 Subject: Why quicksearch sucks In-Reply-To: Your message of "Fri, 15 Nov 2002 21:56:57 +1100." <20021115105657.GA15966@tomato.home> Message-ID: <200211160503.GAA26115@ags.uni-sb.de> Hi Bradley, hi all, > The main problem is that quicksearch entries are inherently slow. We do > a substring search on the description OR status whiteboard for each > word. This means that the best we can get away with is a linear search > of all the bug in teh database. That's true. Note that quicksearch has been designed for an existing bugzilla backend, with the goal of (1) getting a good approximation of "what the b.m.o. user wants" (2) within a "reasonable" amount of time on b.m.o. At the time of the design, and with respect to the typical load of b.m.o at that time, typical requests with 1 - 3 words were served within an acceptable time interval. If this situation has changed (e.g. backend code changed, number of users / queries / bugs has gone up, typical server load has increased), then there are always two alternative approaches: (a) adopt quicksearch to the new situation, or (b) change the situation so that quicksearch still works. In our case, the bugzilla backend code seems to be the only parameter of the situation that we can change; and on the quicksearch side I think changing the search semantics is the only parameter we can tune. Let's keep these two alternatives in mind. > However, we also do a substring match on the product/components. Before > the upgrade, this was just an extra string search. After the upgrade + > bug 43600, this is now a string search on the product/component table, > and an integer equality test on teh bugs table, via a JOIN/ > [...] > So, how do we fix it? The correct fix is to use a subselect for the > product id: > [...] > That then gets us back to the previous search, but probably slightly > faster because of the number checks. > > Which is great, except that mysql doesn't support SUBSELECTs. > > So the alternate solution is to do what was done in bug 21700, and > lookup stuff in joined tables first. I wasnt to do this via some sort of > warpper func which would use subselects for database servers, and a > separate select + IN for mysql. I think this is a good solution. In my experience with a (non-bugzilla) mysql app, the app<->db communication overhead is hardly a problem. Also, if it is too easy to submit queries with a 50000 bugs result set by accident, then it may make sense to define a default limit for a result set (maybe somewhere in the range of 2000-5000, possibly as a per-user pref), so that you need to explicitly ask for the _complete_ result set if you really want it, something like &all_results=1 . I'm not sure whether this would obsolete the need for temp tables on disk, but if it does it may be worth considering. So this would be a possible solution on the bugzilla backend side, dealing with the performance difference for some kinds of queries caused by the latest code changes. On the other side, maybe as a short-term solution, we could adopt quicksearch by just changing the semantics to _not_ include product / component by default, so that you'd have to explicitly specify the "area prefix" (":") if you want to do substring matches in product and component names, and only there. This makes it a bit less intuitive for new users who are not familiar with the actual product/component hierarchy used by mozilla.org, but most of the queries would still find most of the relevant bugs, so having quicksearch available again with that changed semantics may be an improvement over it being disabled completely. And when the real solution is well tested and checked in, the semantics can always be changed back if so desired. I compared the behavior of b.m.o. for a specific example query: 1) the original semantics: http://www.ps.uni-sb.de/~afranke/moz0/quicksearch.html 2) the new semantics: http://www.ps.uni-sb.de/~afranke/moz1/quicksearch.html The patch for quicksearch.js (as a unified diff) is here: http://www.ps.uni-sb.de/~afranke/quicksearch.js.diff 1a) currently on b.m.o., the search for bugzilla quicksearch takes about 17-19 seconds and returns 14 bugs. 1b) the slightly more expert query :bugzilla quicksearch takes about 14-19 seconds and returns 13 bugs. This is the almost the same as the previous result set, missing only bug 159451 ("Bugzilla QuickSearch broken in default Chimera install") which is in a non-bugzilla product because it is probably caused by the browser, not the bugzilla code; so we may tolerate this inaccuracy. 2a) with the semantics changed to not search the product and component names by default, the first query bugzilla quicksearch takes only 4-5 seconds, but returns only a single bug (159451) as a result, since "bugzilla" does not occur in the summary (etc.) in the other bugs. 2b) the second query :bugzilla quicksearch takes 11-12 seconds and returns the same 13 bugs as 1b). So with this change, all the non-expert quicksearch queries where the user just enters some word fragments should be as fast as before the backend code change, but with a slightly different semantics. But I suspect only very few people will notice the difference. And even "expert" queries using the ":" prefix to trigger product and component name matching will be faster because product and component name matching is avoided for all the other search terms. Is this sufficient improvement to make this change and enable quicksearch on b.m.o again? Or are we going for the backend fix only? Cheers, Andreas ============================================================== Here are the query urls for the above examples, taken from http://www.ps.uni-sb.de/~afranke/moz0/quicksearchhack.html and http://www.ps.uni-sb.de/~afranke/moz1/quicksearchhack.html using the "preview query url as page" button: [1a] original query for "bugzilla quicksearch": http://bugzilla.mozilla.org/buglist.cgi ?bug_status=UNCONFIRMED &bug_status=NEW &bug_status=ASSIGNED &bug_status=REOPENED &field0-0-0=product &type0-0-0=substring &value0-0-0=bugzilla &field0-0-1=component &type0-0-1=substring &value0-0-1=bugzilla &field0-0-2=short_desc &type0-0-2=substring &value0-0-2=bugzilla &field0-0-3=status_whiteboard &type0-0-3=substring &value0-0-3=bugzilla &field1-0-0=product &type1-0-0=substring &value1-0-0=quicksearch &field1-0-1=component &type1-0-1=substring &value1-0-1=quicksearch &field1-0-2=short_desc &type1-0-2=substring &value1-0-2=quicksearch &field1-0-3=status_whiteboard &type1-0-3=substring &value1-0-3=quicksearch [1b] original query for ":bugzilla quicksearch" http://bugzilla.mozilla.org/buglist.cgi ?bug_status=UNCONFIRMED &bug_status=NEW &bug_status=ASSIGNED &bug_status=REOPENED &field0-0-0=product &type0-0-0=substring &value0-0-0=bugzilla &field0-0-1=component &type0-0-1=substring &value0-0-1=bugzilla &field1-0-0=product &type1-0-0=substring &value1-0-0=quicksearch &field1-0-1=component &type1-0-1=substring &value1-0-1=quicksearch &field1-0-2=short_desc &type1-0-2=substring &value1-0-2=quicksearch &field1-0-3=status_whiteboard &type1-0-3=substring &value1-0-3=quicksearch [2a] new query for "bugzilla quicksearch": http://bugzilla.mozilla.org/buglist.cgi ?bug_status=UNCONFIRMED &bug_status=NEW &bug_status=ASSIGNED &bug_status=REOPENED &field0-0-0=short_desc &type0-0-0=substring &value0-0-0=bugzilla &field0-0-1=status_whiteboard &type0-0-1=substring &value0-0-1=bugzilla &field1-0-0=short_desc &type1-0-0=substring &value1-0-0=quicksearch &field1-0-1=status_whiteboard &type1-0-1=substring &value1-0-1=quicksearch [2b] new query for ":bugzilla quicksearch": http://bugzilla.mozilla.org/buglist.cgi ?bug_status=UNCONFIRMED &bug_status=NEW &bug_status=ASSIGNED &bug_status=REOPENED &field0-0-0=product &type0-0-0=substring &value0-0-0=bugzilla &field0-0-1=component &type0-0-1=substring &value0-0-1=bugzilla &field1-0-0=short_desc &type1-0-0=substring &value1-0-0=quicksearch &field1-0-1=status_whiteboard &type1-0-1=substring &value1-0-1=quicksearch From bbaetz at student.usyd.edu.au Sat Nov 16 05:29:14 2002 From: bbaetz at student.usyd.edu.au (Bradley Baetz) Date: Sat, 16 Nov 2002 16:29:14 +1100 Subject: Why quicksearch sucks In-Reply-To: <200211160503.GAA26115@ags.uni-sb.de> References: <20021115105657.GA15966@tomato.home> <200211160503.GAA26115@ags.uni-sb.de> Message-ID: <20021116052914.GA4245@tomato.home> On Sat, Nov 16, 2002 at 06:04:56AM +0100, Andreas Franke wrote: > So this would be a possible solution on the bugzilla backend side, > dealing with the performance difference for some kinds of queries > caused by the latest code changes. On the other side, maybe as a > short-term solution, we could adopt quicksearch by just changing > the semantics to _not_ include product / component by default, > so that you'd have to explicitly specify the "area prefix" (":") > if you want to do substring matches in product and component names, > and only there. This doesn't work. The reason is that if I'm searching for 'ftp login failure', then I want to find a bug with the summary 'login failure' in the 'Networking: FTP' component, and not fail because 'ftp' wasn't in the summary. OTOH, I don't see much of a point for including the status whiteboard... > This makes it a bit less intuitive for new users > who are not familiar with the actual product/component hierarchy > used by mozilla.org, but most of the queries would still find > most of the relevant bugs, so having quicksearch available again > with that changed semantics may be an improvement over it being > disabled completely. And when the real solution is well tested > and checked in, the semantics can always be changed back if so > desired. Nope; see above. > Well, the fact that bmo is 40-50 times as slow as myk's test machine points to anohter oppertunity for improvment :) > Is this sufficient improvement to make this change and enable > quicksearch on b.m.o again? Or are we going for the backend > fix only? I thik we do want the backend fix, epscially since custom fields is going to make this basically a requirement. > > Cheers, > Andreas > Bradley From afranke at ags.uni-sb.de Sat Nov 16 08:43:04 2002 From: afranke at ags.uni-sb.de (Andreas Franke) Date: Sat, 16 Nov 2002 09:43:04 +0100 Subject: Why quicksearch sucks In-Reply-To: Your message of "Sat, 16 Nov 2002 16:29:14 +1100." <20021116052914.GA4245@tomato.home> Message-ID: <200211160842.JAA00594@ags.uni-sb.de> > This doesn't work. The reason is that if I'm searching for 'ftp login > failure', then I want to find a bug with the summary 'login failure' in > the 'Networking: FTP' component, and not fail because 'ftp' wasn't in > the summary. The point was that under the assumption that almost all bugs about ftp login failure are located in the ftp component, the query :ftp login failure with the new semantics would give you almost the same results as ftp login failure gives you now. Of course, this requires the user knowledge about the product/component hierarchy, or else relies on redundancy (the majority of bugs in the ftp component contain the substring "ftp" in the summary, too). Actually, your example gives exactly the same result (one bug) in both cases, even without the colon. But your point is taken. Fixing the backend now is certainly much better, unfortunately I can't help on that side. Thanks for your effort, Andreas From gerv at mozilla.org Sat Nov 16 09:43:26 2002 From: gerv at mozilla.org (Gervase Markham) Date: Sat, 16 Nov 2002 09:43:26 +0000 Subject: Why quicksearch sucks In-Reply-To: <20021115105657.GA15966@tomato.home> References: <20021115105657.GA15966@tomato.home> <200211160503.GAA26115@ags.uni-sb.de> <20021116052914.GA4245@tomato.home> Message-ID: <3DD6133E.3010406@mozilla.org> > Well, the fact that bmo is 40-50 times as slow as myk's test machine > points to anohter oppertunity for improvment :) mozilla.org staff are working on getting a new machine - and I think there's a realisation inside Netscape that it's an urgent requirement. But we can't commit to a timescale. > I thik we do want the backend fix, epscially since custom fields is > going to make this basically a requirement. I completely agree that this is the right thing to do. Are you sticking your hand in the air? You are probably the best person to do it, if you have time. Gerv From bbaetz at student.usyd.edu.au Sat Nov 16 11:43:19 2002 From: bbaetz at student.usyd.edu.au (Bradley Baetz) Date: Sat, 16 Nov 2002 22:43:19 +1100 Subject: Why quicksearch sucks In-Reply-To: <3DD6133E.3010406@mozilla.org> References: <20021115105657.GA15966@tomato.home> <200211160503.GAA26115@ags.uni-sb.de> <20021116052914.GA4245@tomato.home> <3DD6133E.3010406@mozilla.org> Message-ID: <20021116114319.GB7542@tomato.home> On Sat, Nov 16, 2002 at 09:43:26AM +0000, Gervase Markham wrote: > >Well, the fact that bmo is 40-50 times as slow as myk's test machine > >points to anohter oppertunity for improvment :) > > mozilla.org staff are working on getting a new machine - and I think > there's a realisation inside Netscape that it's an urgent requirement. > But we can't commit to a timescale. mod_perl will help, too, since we won't be reparsing all these perl files for every single request. > > >I thik we do want the backend fix, epscially since custom fields is > >going to make this basically a requirement. > > I completely agree that this is the right thing to do. Are you sticking > your hand in the air? You are probably the best person to do it, if you > have time. > I'll play with this. Probably won't have time tomorrow, though. > Gerv Bradley From gerv at mozilla.org Sun Nov 17 17:04:29 2002 From: gerv at mozilla.org (Gervase Markham) Date: Sun, 17 Nov 2002 17:04:29 +0000 Subject: Chart selection UI Message-ID: <3DD7CC1D.7070809@mozilla.org> I'm currently working on generic charting. The design is here: If you look at , you'll see that charts have a three-level categorisation. The idea is to use JS to update the second and third level lists as selections are made in the first and second level lists, respectively. The big question is: what do we do for people who have JS switched off? This problem is not comparable to the query page with Products and Components, because selecting just a Component to search on is a perfectly valid search restriction, whereas in with reports you need to select a Category, Sub-category and Name which make a valid data set. So, having all the possibilities in each list is not a valid solution. There are three solutions, none very appealing: 1) Have one big