Please login or register.

Login with username, password and session length
Advanced search  
Pages: [1] 2

Author Topic: [Help][Need your advices] My sNews is now over 10.000 articles  (Read 4158 times)

H.A.C

  • Jr. Member
  • **
  • Karma: 20
  • Posts: 86
  • i love snews community for its great members
    • Chasoft Corporation
[Help][Need your advices] My sNews is now over 10.000 articles
« on: February 06, 2008, 08:34:26 am »

Hi everybody,

I need your advices for my website powered by sNews 1.6.

My sNews now has over 10.000 articles (over 100 categories) at localhost and it will expand day by day. I need your advices before I put it online:

- How to optimize (speedup) sNews?
   I'm using these mods:
    + sNews Accelerator Mod
    + Improve function l($varable) - by postme
    + [MOD] update_articles().

- when/where to index the database?

- are there any another ways to speed up?

And I wonder if sNews can manage a website with thousand of articles?

Thank you in advanced!
Logged
I'm not available ....until the end of the year 2009!
----------------------------
The largest website powered by sNews is in its way to become the biggest!
My great personal website powered by sNews 1.6
http://www.chasoft.net
Come to see how it's great!

Patric Ahlqvist

  • Nobodys perfect, but Im pretty effing close
  • ULTIMATE member
  • ******
  • Karma: 65
  • Posts: 4867
  • I'm a self-made man and worships my creator.
    • p-ahlqvist.com
Re: [Help][Need your advices] My sNews is now over 10.000 articles
« Reply #1 on: February 06, 2008, 08:44:02 am »

HAC, mate... WOW, that's quite a lot of articles, hehe... On localhost ? How come ?

Well, I can't help you with the speeding up part... other than those MOD's you mention, and there might be a few more lurking in the forums. Nor can I answer your index question, but to me it seems as if that would be possible somehow and that this itself perhaps would increase speed if having many articles.

The sNews endurance with heaps of articles, though... This have been tested by, Doug I think... and he found that there was really no limits to what sNews could hold... I'll see if I can find his "testpost" and if I do I'll be back to post that here FYI.
Logged
"It's only dead fish that goes with the flow... "
Updated

henrich

  • Sr. Member
  • ****
  • Karma: 23
  • Posts: 381
  • Passion for quality and excellence!
    • My personal blog and portofolio
Re: [Help][Need your advices] My sNews is now over 10.000 articles
« Reply #2 on: February 06, 2008, 09:06:02 am »

H.A.C, good to see that you have reached that beautiful limit.

One of the most used is the WHERE seftitle="something", seftitle is a good candidate for index.

CREATE INDEX sefindex ON articles(seftitle);

Search also for more WHERE's (i don't know how are called in english :P) and see if they are repeated too much.
Logged
By(e) Henrich :)
------------------------------
IT related blog

H.A.C

  • Jr. Member
  • **
  • Karma: 20
  • Posts: 86
  • i love snews community for its great members
    • Chasoft Corporation
Re: [Help][Need your advices] My sNews is now over 10.000 articles
« Reply #3 on: February 06, 2008, 09:18:51 am »

Quote
HAC, mate... WOW, that's quite a lot of articles, hehe... On localhost ? How come ?

oh, i ripped articles from other websites. I'll tell you if my site is online. The method is quite simple:

this is an example to demonstrate how i get content from other websites.

Code: [Select]
<?php
//the address that i want to rip
$url 'http://www.9down.com/topic-ACD-Systems/';
//get page's content and set to $content
$content file_get_contents($url);
//use preg_match to search for the content I want
preg_match_all('@<div class="lifls1 bj">(.*)</div>@Uus'$content$download);

//..............
//....etc  - collect data... by using preg_match and preg_match_all
//................

//save the collected data to the database - hehe... .
mysql_query("INSERT INTO articles (title, seftitle, text, date, category, position, displaytitle,displayinfo, commentable, published,description_meta, keywords_meta, display_auto, views) VALUES ('$title', '$seftitle', '$text', '$a_date', '$id', '1', 'YES', 'YES', 'YES', '1', '$description_meta', '$keywords_meta', '1', '$pageview[1]')");

?>


Quote
there was really no limits to what sNews could hold
thanks sNews community.
« Last Edit: February 06, 2008, 09:23:57 am by H.A.C »
Logged
I'm not available ....until the end of the year 2009!
----------------------------
The largest website powered by sNews is in its way to become the biggest!
My great personal website powered by sNews 1.6
http://www.chasoft.net
Come to see how it's great!

Joost

  • Guest
Re: [Help][Need your advices] My sNews is now over 10.000 articles
« Reply #4 on: February 06, 2008, 09:20:00 am »

I haven't heard of that much articles run on sNews, yet. I guess your 'localhost' is not an ordinary XP.
Indexes... well I've been reading on the stuff all night. But Codetwist is the expert on that topic.
I guess an index on seftitle is always good.

If possible disable or at least LIMIT archives and sitemap. Replace your old function categories with  this function categories and don't display number next to the categories. If possible don't display new articles on home.

Good luck. :)

Logged

codetwist

  • Hero Member
  • *****
  • Karma: 50
  • Posts: 940
Re: [Help][Need your advices] My sNews is now over 10.000 articles
« Reply #5 on: February 06, 2008, 09:33:42 am »

Indexes on seftitle and category is a must have unless You want MySQL doing full table scans when retrieving single record or single category articles. Additionally, if You are sorting records in particular order apart from id then indexes can help with that as well.
Logged

henrich

  • Sr. Member
  • ****
  • Karma: 23
  • Posts: 381
  • Passion for quality and excellence!
    • My personal blog and portofolio
Re: [Help][Need your advices] My sNews is now over 10.000 articles
« Reply #6 on: February 06, 2008, 09:44:54 am »

Pagination for archives and sitemap is welcomed?!  ;D
Logged
By(e) Henrich :)
------------------------------
IT related blog

Patric Ahlqvist

  • Nobodys perfect, but Im pretty effing close
  • ULTIMATE member
  • ******
  • Karma: 65
  • Posts: 4867
  • I'm a self-made man and worships my creator.
    • p-ahlqvist.com
Re: [Help][Need your advices] My sNews is now over 10.000 articles
« Reply #7 on: February 06, 2008, 10:55:45 am »

Pagination for archives and sitemap is welcomed?!  ;D

Yes, indeed... when it comes to having this amount of articles/cat's there is def a need for pagination for those... Maybe a li'l something for the next version, eh ?
Logged
"It's only dead fish that goes with the flow... "
Updated

Patric Ahlqvist

  • Nobodys perfect, but Im pretty effing close
  • ULTIMATE member
  • ******
  • Karma: 65
  • Posts: 4867
  • I'm a self-made man and worships my creator.
    • p-ahlqvist.com
Re: [Help][Need your advices] My sNews is now over 10.000 articles
« Reply #8 on: February 06, 2008, 10:57:41 am »

And I wonder if sNews can manage a website with thousand of articles?

Here's Doug's little note on this. http://snewscms.com/forum/index.php?topic=6558.msg44420#msg44420 which indeed indicates that a few thounsand articles... aren't a problem ;)
Logged
"It's only dead fish that goes with the flow... "
Updated

H.A.C

  • Jr. Member
  • **
  • Karma: 20
  • Posts: 86
  • i love snews community for its great members
    • Chasoft Corporation
Re: [Help][Need your advices] My sNews is now over 10.000 articles
« Reply #9 on: February 07, 2008, 01:57:01 am »

Thank you very much for all of your replies. I'll publish my website as soon as possible. Then we can see a really big website using sNews with thousands of articles in action.
Logged
I'm not available ....until the end of the year 2009!
----------------------------
The largest website powered by sNews is in its way to become the biggest!
My great personal website powered by sNews 1.6
http://www.chasoft.net
Come to see how it's great!

H.A.C

  • Jr. Member
  • **
  • Karma: 20
  • Posts: 86
  • i love snews community for its great members
    • Chasoft Corporation
Re: [Help][Need your advices] My sNews is now over 10.000 articles
« Reply #10 on: February 11, 2008, 05:11:49 pm »

I've just upload my testing website at http://www.chasoft.net - by this time it has 3951 completed articles. Maybe at the end of this month, I'll publish over 20.000 articles.
Logged
I'm not available ....until the end of the year 2009!
----------------------------
The largest website powered by sNews is in its way to become the biggest!
My great personal website powered by sNews 1.6
http://www.chasoft.net
Come to see how it's great!

H.A.C

  • Jr. Member
  • **
  • Karma: 20
  • Posts: 86
  • i love snews community for its great members
    • Chasoft Corporation
Re: [Help][Need your advices] My sNews is now over 10.000 articles
« Reply #11 on: February 12, 2008, 06:19:59 pm »

The world largest website powered by sNews is in its way to become the biggest. But this time It has exactly 11.254 articles. And counting hundreds by hours... Come to http://www.chasoft.net to see how big it is. I hope to grow the number of articles up to 30.000. (maybe just the next two or three days)

UPDATE:

15.553 articles and counting.

16.331 articles and counting.

I'm trying to reach 30.000 articles
« Last Edit: February 13, 2008, 03:36:27 am by H.A.C »
Logged
I'm not available ....until the end of the year 2009!
----------------------------
The largest website powered by sNews is in its way to become the biggest!
My great personal website powered by sNews 1.6
http://www.chasoft.net
Come to see how it's great!

stjepan

  • Full Member
  • ***
  • Karma: 3
  • Posts: 136
Re: [Help][Need your advices] My sNews is now over 10.000 articles
« Reply #12 on: February 13, 2008, 01:26:25 pm »

So, you are indexing other site's content. Are you trying to make new Google or Yahoo?

H.A.C

  • Jr. Member
  • **
  • Karma: 20
  • Posts: 86
  • i love snews community for its great members
    • Chasoft Corporation
Re: [Help][Need your advices] My sNews is now over 10.000 articles
« Reply #13 on: February 13, 2008, 01:56:39 pm »

So, you are indexing other site's content. Are you trying to make new Google or Yahoo?

Yes, I'm indexing other site's content. Updated 20.425 articles and counting. Just to practice PREG functions.  ;D I think there will be much fun with PREG functions.  ::)
Logged
I'm not available ....until the end of the year 2009!
----------------------------
The largest website powered by sNews is in its way to become the biggest!
My great personal website powered by sNews 1.6
http://www.chasoft.net
Come to see how it's great!

invarbrass

  • Full Member
  • ***
  • Karma: 18
  • Posts: 117
    • http://snews.extremebittorrent.com
Re: [Help][Need your advices] My sNews is now over 10.000 articles
« Reply #14 on: February 13, 2008, 02:28:20 pm »

Very impressive HAC! You must've been putting a hell of a lot of efforts on the site.
And the site performance is also impressive. Are you using any mods? Looks like the snews ME mods are installed....
Logged
Pages: [1] 2