358 Lotus blogs updated hourly. Who will post next? Home | Downloads | Events | Pods | Blogs | Search | myPL | About 
 
Latest 7 Posts
Atlassian SourceTree Pro-Tip
Wed, Nov 26th 2014 300
Loading widget data in IBM Connections 5 by the aggregator
Wed, Nov 19th 2014 235
Presentation from Social Connections VII Stockholm
Mon, Nov 17th 2014 230
An important tool results from the whole POODLE/SHA-2 debacle
Mon, Nov 10th 2014 506
IBM Domino, POODLE, SHA-1 and why it's also sad when IBM decides to update the security stack
Mon, Oct 27th 2014 620
Mac Yosemite, Java, IBM Notes and OnTime Group Calendar
Fri, Oct 17th 2014 468
How to increase the number of worker threads for different internet protocols
Mon, Oct 13th 2014 145
Top 10
IBM Domino, POODLE, SHA-1 and why it's also sad when IBM decides to update the security stack
Mon, Oct 27th 2014 620
An important tool results from the whole POODLE/SHA-2 debacle
Mon, Nov 10th 2014 506
Mac Yosemite, Java, IBM Notes and OnTime Group Calendar
Fri, Oct 17th 2014 468
Atlassian SourceTree Pro-Tip
Wed, Nov 26th 2014 300
Loading widget data in IBM Connections 5 by the aggregator
Wed, Nov 19th 2014 235
Presentation from Social Connections VII Stockholm
Mon, Nov 17th 2014 230
Installing TDI v. 7.1 on Windows Server 2012
Wed, May 7th 2014 215
Terminology is the most important thing to know when when starting out with WebSphere Application Server
Fri, Nov 29th 2013 191
How to increase the number of worker threads for different internet protocols
Mon, Oct 13th 2014 145
Premaster RSA secret error with 4096-bit encryption in WAS ISC
Sun, Jun 15th 2014 130


A tale from a customer reaching (and exceeding) the 64 gb limit
   

As I've tweeted I have spent the last couple of days (and the weekend) helping out a customer that exceeded the hard 64 gb database size limit in Lotus Domino. Before discussing how we solved the problem and got the customer back in business I would like you to think about how situations like this could be avoided. And avoiding it is key as once you exceed the size you're doomed.

First --- how and why database platform would EVER allow a database to cross a file size that makes it break. Why doesn't Domino start to complain at 50gb and make the warnings progressively harder to ignore as the database gets closer to 64gb. Why doesn't it refuse data once it reaches 60gb? I find it totally unacceptable that a software product allows a database to exceed a size it knows it cannot handle.

Now I know that there are considerations for such a warning and that it could be done in application code (e.g. database script, QueryOpen event) but it really isn't something an application developer should think about. Also it should be applied to backend logic as well and really doesn't lend itself to a UI computation. I also know that DDM or similar could warn about it but it still doesn't change my stance. The 64gb limit is a hard limit and reaching, and exceeding it, shouldn't depend on me configuring a specific piece of functionality.

Second -- having the option of keeping the view index in another location/file than the database would have helped. This has been brought up a number of times including at Lotusphere Ask-The-Developers sessions. One could argue that externalizing the view index from the database would just have postponed the problem but the view index takes up a substantial amount of disk for databases of this size.

Now on to how we saved the data.

The bottom line in this is that the customer was lucky. VERY lucky. The customer uses Cisco IP telephones and keeps a replica of the database in question on a secondary server for phone number lookup using a Java servlet. Due to the way the way the servlet is written only as single, very small, view was built on the secondary server. This is turn meant that the database that had exceeded 64 gb on the primary server was "only" 55 gb on the secondary server. The database on the primary server was toast and gave out very interesting messages if attempting the access or fixup the database:

**** DbMarkCorruptAgain(Both SB copies are corrupt)
So thank God they had the secondary server otherwise the outcome of the story would have been less pleasant because using the secondary server we were able to:
  1. Take the database offline (restrict access using ACL)
  2. Purge all view indexes (using Ytria ViewEZ)
  3. Create a database design only copy to hold archived documents
  4. Delete all views to avoid them accidentally being built
  5. Build a very simple view to prepare for data archiving
  6. Write a LotusScript to archive documents (copy then delete) from the database
  7. Use Ytria ScanEZ to delete deletion stubs from the database (this works for them because the database isn't replicated to user workstations or laptops)
  8. Do a compact to reclaim unused space
  9. Make the database available on the primary server
Whew! They are now back in business after building views in the database. They were lucky - VERY lucky. If they hadn't had that secondary replica the data would probably have been lost to much distress. To them and me.

So what are the main take aways from this?

  1. UI check -- in the future all databases that I develop will have a database script check on the database size to try and prevent situations like this
  2. DAOS -- enable DAOS for databases to keep attachments out of the database and keep the size down
  3. Monitoring -- monitor databases either using DDM or other tools to try and prevent sitations like this

And so concludes a story from the field. 4 days later where my hair have turned gray from watching copy/fixup/compact progress indicators the customer is back in and happy once again. Whew!!



---------------------
http://lekkimworld.com/2011/05/18/a_tale_from_a_customer_reaching_and_exceeding_the_64_gb_limit.html
May 18, 2011
37 hits



Recent Blog Posts
300


Atlassian SourceTree Pro-Tip
Wed, Nov 26th 2014 1:01p   Mikkel Heisterberg
I'm finding myself use Atlassian SourceTree more and more for my Git work as it's both intuitive, fast and very pleasing to the eye. Yesterday at an Atlassian event (Getting Git Right) I noticed that the branches were nested in one of the demos. I wondered how they did that but it turns out to be very simple. If you (re)name a branch and use slashes (/) in the name then SourceTree will automatically nest them. Very nice and does make it easier to distinguish between feature, release, bugfix br [read] Keywords:
235


Loading widget data in IBM Connections 5 by the aggregator
Wed, Nov 19th 2014 3:07a   Mikkel Heisterberg
One of the areas that changed fundamentally in IBM Connections 5 is how widget resources (JavaScript and CSS) is loaded by the browser. In prior versions the resources were loaded by the end-user browser through the AJAX proxy in IBM Connections Profiles or Communities depending on the feature in use. Starting with IBM Connections 5 the resources are aggregated and loaded by the Common feature that now also caches the resources. For end users this is great as speed and performance improves but f [read] Keywords: connections ibm ajax css javascript widget
230


Presentation from Social Connections VII Stockholm
Mon, Nov 17th 2014 3:10a   Mikkel Heisterberg
Below is my presentation from Social Connections VII in Stockholm on 13-14 November 2014. [read] Keywords: connections
506


An important tool results from the whole POODLE/SHA-2 debacle
Mon, Nov 10th 2014 1:41a   Mikkel Heisterberg
My stance on the POODLE / SHA-2 issues with Domino is well known and I haven't been holding anything back. And now - after a while - IBM is starting to release the promised tools to lay the foundation for SHA-2 signature support and TLS 1.0 support on IBM Domino. As part of my IBM Support Updates today I saw and entry called "Planned SHA-2 deliveries for IBM Domino 9.x". This is a technote outlining how IBM is bringing TLS 1.0 and SHA-2 support. This is all well and good and great that IBM st [read] Keywords: domino ibm ldd lotus linux
620


IBM Domino, POODLE, SHA-1 and why it's also sad when IBM decides to update the security stack
Mon, Oct 27th 2014 2:00a   Mikkel Heisterberg
Over the last few weeks the news hit about the PODDLE attack and the withdrawal of SHA-1 as an acceptable hash algorithm by Google Chrome. This is turn has prompted IBM to update the security stack in IBM Domino for all web protocols incl HTTP, LDAP and SMTP. While this is VERY good news and it will be very welcomed that we do no longer have to resort to fronting IBM Domino by IBM HTTP Server or Apache to get adequate TLS protocol support I find the whole situation a bit sad. In full disclosure [read] Keywords: domino ibm google microsoft network podcast security server smtp
468


Mac Yosemite, Java, IBM Notes and OnTime Group Calendar
Fri, Oct 17th 2014 1:51a   Mikkel Heisterberg
After upgrading my Mac to OS X Yosemite (10.10) I had to reinstall Java to make IBM Notes startup just like Rene describes. To install go to the download page for Java on apple.com, download and install. It takes around 5 minutes and you are ready to go. Once installed the Java runtime makes IBM Notes fly again and I can confirm that the OnTime Group Calendar UI's run just fine on OS X Yosemite. [read] Keywords: ibm notes apple eclipse java mac




145


How to increase the number of worker threads for different internet protocols
Mon, Oct 13th 2014 9:13a   Mikkel Heisterberg
Came across this technote outlining how to configure the worker threads for the different internet protocols on IBM Domino. How to increase the number of worker threads for different internet protocols [read] Keywords: domino ibm
99


WebSphere Application Server Liberty Profile webcast replay
Wed, Aug 6th 2014 10:47p   Mikkel Heisterberg
In case you haven't heard about WebSphere Application Server Liberty Profile and you are doing any work with J(2)EE servers you really should do your self the favour and read up on it. In essence it's the best thing since sliced bread for application developers that target WebSphere Application Server and here's why: It downloads and installs in less that 5 minutes It's binary compatible with the full WebSphere Application Server so you can be certain that code that runs on Liberty Profile [read] Keywords: ibm application eclipse mac profile server websphere
88


Social Connections VI Prague - An introduction to IBM Connections as an appdev platform
Tue, Jun 17th 2014 5:50a   Mikkel Heisterberg
[read] Keywords: connections ibm
130


Premaster RSA secret error with 4096-bit encryption in WAS ISC
Sun, Jun 15th 2014 11:40p   Mikkel Heisterberg
Had a customer the other day that couldn't import their SSL certificate into the WebSphere Application Server (WAS) Integrated Solutions Console (ISC) due to a "RSA premaster secret" error being shown when attempting the import. A PMR with IBM Support confirmed my suspicion that export restrictions was in play. Here is the response from IBM Support. The premaster RSA secret error with 4096-bit encryption is usually due to the unrestricted JCE policy requirement. Please, try to install the [read] Keywords: ibm application java password security server websphere




Created and Maintained by Yancy Lent - About - Blog Submission - Suggestions - Change Log - Blog Widget - Advertising - Mobile Edition